Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 834307 Details for
Bug 1039537
[RHSC] "VdcBLLException: NO_UP_SERVER_FOUND" in seen in engine logs
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
engine logs
engine.log (text/x-log), 9.10 MB, created by
Shruti Sampat
on 2013-12-09 11:31:17 UTC
(
hide
)
Description:
engine logs
Filename:
MIME Type:
Creator:
Shruti Sampat
Created:
2013-12-09 11:31:17 UTC
Size:
9.10 MB
patch
obsolete
>2013-12-09 03:09:03,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c45f095 >2013-12-09 03:09:04,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5c45f095 >2013-12-09 03:09:04,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 117ef332 >2013-12-09 03:09:04,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 117ef332 >2013-12-09 03:09:09,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29d792b >2013-12-09 03:09:10,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 29d792b >2013-12-09 03:09:10,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e3fde6e >2013-12-09 03:09:10,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e3fde6e >2013-12-09 03:09:15,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31946ac9 >2013-12-09 03:09:15,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 31946ac9 >2013-12-09 03:09:15,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 416ac58f >2013-12-09 03:09:16,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 416ac58f >2013-12-09 03:09:21,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c9ea393 >2013-12-09 03:09:21,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c9ea393 >2013-12-09 03:09:21,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f26280b >2013-12-09 03:09:21,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f26280b >2013-12-09 03:09:26,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 731fa603 >2013-12-09 03:09:27,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 731fa603 >2013-12-09 03:09:27,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e107246 >2013-12-09 03:09:27,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e107246 >2013-12-09 03:09:32,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3df735a8 >2013-12-09 03:09:33,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3df735a8 >2013-12-09 03:09:33,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31bcfe3c >2013-12-09 03:09:33,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31bcfe3c >2013-12-09 03:09:38,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77774899 >2013-12-09 03:09:38,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 77774899 >2013-12-09 03:09:38,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5cb1345c >2013-12-09 03:09:39,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cb1345c >2013-12-09 03:09:44,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b3707c8 >2013-12-09 03:09:44,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4b3707c8 >2013-12-09 03:09:44,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69a559d0 >2013-12-09 03:09:44,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69a559d0 >2013-12-09 03:09:49,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71ad06dd >2013-12-09 03:09:50,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 71ad06dd >2013-12-09 03:09:50,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36616d0 >2013-12-09 03:09:50,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36616d0 >2013-12-09 03:09:51,498 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-22) No up server in cluster >2013-12-09 03:09:51,498 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-22) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:09:51,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47a9a2a0 >2013-12-09 03:09:51,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterTasksListVDSCommand, return: [], log id: 47a9a2a0 >2013-12-09 03:09:55,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 320a44f3 >2013-12-09 03:09:56,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 320a44f3 >2013-12-09 03:09:56,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59c3408 >2013-12-09 03:09:56,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59c3408 >2013-12-09 03:10:01,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2585828 >2013-12-09 03:10:01,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2585828 >2013-12-09 03:10:01,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16fde368 >2013-12-09 03:10:02,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16fde368 >2013-12-09 03:10:07,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 337a34d3 >2013-12-09 03:10:07,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 337a34d3 >2013-12-09 03:10:07,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c0b595a >2013-12-09 03:10:08,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c0b595a >2013-12-09 03:10:13,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1449cc89 >2013-12-09 03:10:13,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1449cc89 >2013-12-09 03:10:13,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b1f4499 >2013-12-09 03:10:13,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b1f4499 >2013-12-09 03:10:18,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a070085 >2013-12-09 03:10:19,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7a070085 >2013-12-09 03:10:19,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a601b8f >2013-12-09 03:10:19,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a601b8f >2013-12-09 03:10:24,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 148da801 >2013-12-09 03:10:25,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 148da801 >2013-12-09 03:10:25,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 101594ae >2013-12-09 03:10:25,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 101594ae >2013-12-09 03:10:30,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45e93867 >2013-12-09 03:10:30,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 45e93867 >2013-12-09 03:10:30,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 705bfa94 >2013-12-09 03:10:31,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 705bfa94 >2013-12-09 03:10:36,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 398f305a >2013-12-09 03:10:36,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 398f305a >2013-12-09 03:10:36,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 103b33a3 >2013-12-09 03:10:36,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 103b33a3 >2013-12-09 03:10:41,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: aaae27f >2013-12-09 03:10:42,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: aaae27f >2013-12-09 03:10:42,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11dad9fb >2013-12-09 03:10:42,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11dad9fb >2013-12-09 03:10:47,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55766e8 >2013-12-09 03:10:48,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 55766e8 >2013-12-09 03:10:48,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 789a9810 >2013-12-09 03:10:48,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 789a9810 >2013-12-09 03:10:51,778 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) No up server in cluster >2013-12-09 03:10:51,778 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:10:51,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8f2c1bb >2013-12-09 03:10:52,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterTasksListVDSCommand, return: [], log id: 8f2c1bb >2013-12-09 03:10:53,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a6318e3 >2013-12-09 03:10:53,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a6318e3 >2013-12-09 03:10:53,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1399d00b >2013-12-09 03:10:54,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1399d00b >2013-12-09 03:10:59,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66fa6ef1 >2013-12-09 03:10:59,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 66fa6ef1 >2013-12-09 03:10:59,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5cb3e9f5 >2013-12-09 03:11:00,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cb3e9f5 >2013-12-09 03:11:05,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a9a37fe >2013-12-09 03:11:05,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: a9a37fe >2013-12-09 03:11:05,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 305be6dc >2013-12-09 03:11:05,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 305be6dc >2013-12-09 03:11:10,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23d19f1f >2013-12-09 03:11:11,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 23d19f1f >2013-12-09 03:11:11,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e0200a >2013-12-09 03:11:11,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e0200a >2013-12-09 03:11:16,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 506e050f >2013-12-09 03:11:17,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 506e050f >2013-12-09 03:11:17,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ce69fc >2013-12-09 03:11:17,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ce69fc >2013-12-09 03:11:22,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 481ae3a5 >2013-12-09 03:11:22,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 481ae3a5 >2013-12-09 03:11:22,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a23481e >2013-12-09 03:11:23,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a23481e >2013-12-09 03:11:28,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 765d9242 >2013-12-09 03:11:28,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 765d9242 >2013-12-09 03:11:28,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f58afb1 >2013-12-09 03:11:28,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f58afb1 >2013-12-09 03:11:33,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 585bf985 >2013-12-09 03:11:34,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 585bf985 >2013-12-09 03:11:34,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25adbcb >2013-12-09 03:11:34,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25adbcb >2013-12-09 03:11:39,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50dc4e81 >2013-12-09 03:11:40,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 50dc4e81 >2013-12-09 03:11:40,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50b60ec5 >2013-12-09 03:11:40,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50b60ec5 >2013-12-09 03:11:45,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20f60f55 >2013-12-09 03:11:46,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 20f60f55 >2013-12-09 03:11:46,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3682ef31 >2013-12-09 03:11:46,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3682ef31 >2013-12-09 03:11:51,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f5758f9 >2013-12-09 03:11:51,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f5758f9 >2013-12-09 03:11:51,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b3ec01d >2013-12-09 03:11:52,048 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-46) No up server in cluster >2013-12-09 03:11:52,048 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-46) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:11:52,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6fc1fe98 >2013-12-09 03:11:52,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b3ec01d >2013-12-09 03:11:52,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6fc1fe98 >2013-12-09 03:11:57,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76c1662 >2013-12-09 03:11:57,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 76c1662 >2013-12-09 03:11:57,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9909eef >2013-12-09 03:11:57,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9909eef >2013-12-09 03:12:02,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72dfa924 >2013-12-09 03:12:03,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 72dfa924 >2013-12-09 03:12:03,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 287a252d >2013-12-09 03:12:03,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 287a252d >2013-12-09 03:12:08,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3076f6b4 >2013-12-09 03:12:09,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3076f6b4 >2013-12-09 03:12:09,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 543fb78c >2013-12-09 03:12:09,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 543fb78c >2013-12-09 03:12:14,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79f24898 >2013-12-09 03:12:14,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 79f24898 >2013-12-09 03:12:14,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 125db7bc >2013-12-09 03:12:15,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 125db7bc >2013-12-09 03:12:20,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f664095 >2013-12-09 03:12:20,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: f664095 >2013-12-09 03:12:20,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b9c8c62 >2013-12-09 03:12:21,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b9c8c62 >2013-12-09 03:12:26,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d3ee41c >2013-12-09 03:12:26,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d3ee41c >2013-12-09 03:12:26,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78e81025 >2013-12-09 03:12:26,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78e81025 >2013-12-09 03:12:31,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f90b800 >2013-12-09 03:12:32,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5f90b800 >2013-12-09 03:12:32,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 177df55f >2013-12-09 03:12:32,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 177df55f >2013-12-09 03:12:37,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b339a77 >2013-12-09 03:12:38,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1b339a77 >2013-12-09 03:12:38,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b98266d >2013-12-09 03:12:38,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b98266d >2013-12-09 03:12:43,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27b9b829 >2013-12-09 03:12:43,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 27b9b829 >2013-12-09 03:12:43,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 82298d5 >2013-12-09 03:12:44,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 82298d5 >2013-12-09 03:12:49,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3bde79b9 >2013-12-09 03:12:49,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3bde79b9 >2013-12-09 03:12:49,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d4b0cde >2013-12-09 03:12:49,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d4b0cde >2013-12-09 03:12:52,317 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-92) No up server in cluster >2013-12-09 03:12:52,317 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-92) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:12:52,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46c73a56 >2013-12-09 03:12:52,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterTasksListVDSCommand, return: [], log id: 46c73a56 >2013-12-09 03:12:54,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c704ba7 >2013-12-09 03:12:55,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c704ba7 >2013-12-09 03:12:55,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a85c80 >2013-12-09 03:12:55,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a85c80 >2013-12-09 03:13:00,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f2ea1b5 >2013-12-09 03:13:01,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f2ea1b5 >2013-12-09 03:13:01,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b648093 >2013-12-09 03:13:01,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b648093 >2013-12-09 03:13:06,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4fda34b4 >2013-12-09 03:13:06,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4fda34b4 >2013-12-09 03:13:06,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2767d966 >2013-12-09 03:13:07,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2767d966 >2013-12-09 03:13:12,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63a9324b >2013-12-09 03:13:12,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 63a9324b >2013-12-09 03:13:12,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 286d518d >2013-12-09 03:13:13,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 286d518d >2013-12-09 03:13:18,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3580f999 >2013-12-09 03:13:18,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3580f999 >2013-12-09 03:13:18,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52b7ee1d >2013-12-09 03:13:18,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52b7ee1d >2013-12-09 03:13:24,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 660d45e5 >2013-12-09 03:13:24,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 660d45e5 >2013-12-09 03:13:24,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2cb54c >2013-12-09 03:13:24,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2cb54c >2013-12-09 03:13:29,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 137a58fa >2013-12-09 03:13:30,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 137a58fa >2013-12-09 03:13:30,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d8d5f54 >2013-12-09 03:13:30,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d8d5f54 >2013-12-09 03:13:35,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b127f39 >2013-12-09 03:13:36,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5b127f39 >2013-12-09 03:13:36,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3310d2f >2013-12-09 03:13:36,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3310d2f >2013-12-09 03:13:41,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3283696 >2013-12-09 03:13:41,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3283696 >2013-12-09 03:13:41,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17711465 >2013-12-09 03:13:42,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17711465 >2013-12-09 03:13:47,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ed50ab5 >2013-12-09 03:13:47,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1ed50ab5 >2013-12-09 03:13:47,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a86aedd >2013-12-09 03:13:47,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a86aedd >2013-12-09 03:13:52,605 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-16) No up server in cluster >2013-12-09 03:13:52,606 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-16) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:13:52,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 610f1509 >2013-12-09 03:13:52,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterTasksListVDSCommand, return: [], log id: 610f1509 >2013-12-09 03:13:52,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c5934e3 >2013-12-09 03:13:53,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c5934e3 >2013-12-09 03:13:53,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6865b8d8 >2013-12-09 03:13:53,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6865b8d8 >2013-12-09 03:13:58,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e0edc9e >2013-12-09 03:13:59,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e0edc9e >2013-12-09 03:13:59,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 401ab5f >2013-12-09 03:13:59,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 401ab5f >2013-12-09 03:14:04,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 217a72ff >2013-12-09 03:14:05,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 217a72ff >2013-12-09 03:14:05,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 990cad >2013-12-09 03:14:05,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 990cad >2013-12-09 03:14:10,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 775764e6 >2013-12-09 03:14:10,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 775764e6 >2013-12-09 03:14:10,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35f055b1 >2013-12-09 03:14:11,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35f055b1 >2013-12-09 03:14:16,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 389a4154 >2013-12-09 03:14:16,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 389a4154 >2013-12-09 03:14:16,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21f14e67 >2013-12-09 03:14:16,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21f14e67 >2013-12-09 03:14:21,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 384b33e7 >2013-12-09 03:14:22,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 384b33e7 >2013-12-09 03:14:22,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4278d61b >2013-12-09 03:14:22,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4278d61b >2013-12-09 03:14:27,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c3f4975 >2013-12-09 03:14:28,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7c3f4975 >2013-12-09 03:14:28,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4244f7bf >2013-12-09 03:14:28,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4244f7bf >2013-12-09 03:14:33,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bac8cb >2013-12-09 03:14:33,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4bac8cb >2013-12-09 03:14:33,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ac94735 >2013-12-09 03:14:34,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ac94735 >2013-12-09 03:14:39,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4cd1e74b >2013-12-09 03:14:39,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4cd1e74b >2013-12-09 03:14:39,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3399521c >2013-12-09 03:14:39,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3399521c >2013-12-09 03:14:44,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a10ca98 >2013-12-09 03:14:45,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a10ca98 >2013-12-09 03:14:45,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b9cd4d >2013-12-09 03:14:45,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b9cd4d >2013-12-09 03:14:50,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3eebae16 >2013-12-09 03:14:51,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3eebae16 >2013-12-09 03:14:51,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1683708b >2013-12-09 03:14:51,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1683708b >2013-12-09 03:14:52,899 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-39) [63f3d095] No up server in cluster >2013-12-09 03:14:52,899 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-39) [63f3d095] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:14:52,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 428d23b0 >2013-12-09 03:14:53,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterTasksListVDSCommand, return: [], log id: 428d23b0 >2013-12-09 03:14:56,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e46e48c >2013-12-09 03:14:57,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e46e48c >2013-12-09 03:14:57,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6dbf240c >2013-12-09 03:14:57,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6dbf240c >2013-12-09 03:15:02,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a2edce1 >2013-12-09 03:15:02,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a2edce1 >2013-12-09 03:15:02,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18439ba >2013-12-09 03:15:03,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18439ba >2013-12-09 03:15:08,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19b16847 >2013-12-09 03:15:08,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19b16847 >2013-12-09 03:15:08,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 712c5753 >2013-12-09 03:15:08,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 712c5753 >2013-12-09 03:15:13,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4903978e >2013-12-09 03:15:14,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4903978e >2013-12-09 03:15:14,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b5e31ba >2013-12-09 03:15:14,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b5e31ba >2013-12-09 03:15:19,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6bf254d >2013-12-09 03:15:20,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6bf254d >2013-12-09 03:15:20,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ab5c5f8 >2013-12-09 03:15:20,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ab5c5f8 >2013-12-09 03:15:25,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d62a935 >2013-12-09 03:15:25,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d62a935 >2013-12-09 03:15:25,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5bd19a6 >2013-12-09 03:15:26,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5bd19a6 >2013-12-09 03:15:31,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17e4105e >2013-12-09 03:15:31,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 17e4105e >2013-12-09 03:15:31,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4670880 >2013-12-09 03:15:31,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4670880 >2013-12-09 03:15:36,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: da2622f >2013-12-09 03:15:37,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: da2622f >2013-12-09 03:15:37,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c1c62f8 >2013-12-09 03:15:37,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c1c62f8 >2013-12-09 03:15:42,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a6163bf >2013-12-09 03:15:43,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a6163bf >2013-12-09 03:15:43,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17a4d78a >2013-12-09 03:15:43,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17a4d78a >2013-12-09 03:15:48,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b6fd98f >2013-12-09 03:15:48,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b6fd98f >2013-12-09 03:15:48,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5140510a >2013-12-09 03:15:49,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5140510a >2013-12-09 03:15:53,187 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-25) No up server in cluster >2013-12-09 03:15:53,187 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-25) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:15:53,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c3986aa >2013-12-09 03:15:53,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterTasksListVDSCommand, return: [], log id: c3986aa >2013-12-09 03:15:54,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3531b507 >2013-12-09 03:15:54,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3531b507 >2013-12-09 03:15:54,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31fbeee1 >2013-12-09 03:15:54,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31fbeee1 >2013-12-09 03:15:59,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59a6d99a >2013-12-09 03:16:00,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 59a6d99a >2013-12-09 03:16:00,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6309da69 >2013-12-09 03:16:00,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6309da69 >2013-12-09 03:16:05,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a89f60e >2013-12-09 03:16:06,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: a89f60e >2013-12-09 03:16:06,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ed731c >2013-12-09 03:16:06,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ed731c >2013-12-09 03:16:11,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1069c14f >2013-12-09 03:16:12,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1069c14f >2013-12-09 03:16:12,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3960a2fb >2013-12-09 03:16:12,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3960a2fb >2013-12-09 03:16:17,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d5d0d27 >2013-12-09 03:16:17,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d5d0d27 >2013-12-09 03:16:17,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6dabf7ee >2013-12-09 03:16:18,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6dabf7ee >2013-12-09 03:16:23,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b6dd58 >2013-12-09 03:16:23,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6b6dd58 >2013-12-09 03:16:23,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b1c8fc5 >2013-12-09 03:16:23,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b1c8fc5 >2013-12-09 03:16:28,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a9a4887 >2013-12-09 03:16:29,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a9a4887 >2013-12-09 03:16:29,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39e3729a >2013-12-09 03:16:29,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39e3729a >2013-12-09 03:16:34,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ee02e71 >2013-12-09 03:16:35,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ee02e71 >2013-12-09 03:16:35,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b45390c >2013-12-09 03:16:35,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b45390c >2013-12-09 03:16:40,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6013325c >2013-12-09 03:16:40,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6013325c >2013-12-09 03:16:40,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 134c8a51 >2013-12-09 03:16:41,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 134c8a51 >2013-12-09 03:16:46,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 376c242c >2013-12-09 03:16:46,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 376c242c >2013-12-09 03:16:46,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73b8ba9e >2013-12-09 03:16:46,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73b8ba9e >2013-12-09 03:16:52,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b94f9cd >2013-12-09 03:16:52,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b94f9cd >2013-12-09 03:16:52,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f505a2b >2013-12-09 03:16:52,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f505a2b >2013-12-09 03:16:53,482 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-27) No up server in cluster >2013-12-09 03:16:53,482 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-27) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:16:53,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a1d22d2 >2013-12-09 03:16:53,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1a1d22d2 >2013-12-09 03:16:57,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56906839 >2013-12-09 03:16:58,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 56906839 >2013-12-09 03:16:58,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f7d69f8 >2013-12-09 03:16:58,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f7d69f8 >2013-12-09 03:17:03,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fff409 >2013-12-09 03:17:04,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7fff409 >2013-12-09 03:17:04,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 740abfca >2013-12-09 03:17:04,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 740abfca >2013-12-09 03:17:09,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b67c757 >2013-12-09 03:17:09,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4b67c757 >2013-12-09 03:17:09,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 388b6bfe >2013-12-09 03:17:10,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 388b6bfe >2013-12-09 03:17:15,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71fd98c2 >2013-12-09 03:17:15,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 71fd98c2 >2013-12-09 03:17:15,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 761776a9 >2013-12-09 03:17:15,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 761776a9 >2013-12-09 03:17:20,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 564f89d2 >2013-12-09 03:17:21,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 564f89d2 >2013-12-09 03:17:21,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40bfccc2 >2013-12-09 03:17:21,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40bfccc2 >2013-12-09 03:17:26,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56b7d500 >2013-12-09 03:17:27,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 56b7d500 >2013-12-09 03:17:27,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39ad1779 >2013-12-09 03:17:27,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39ad1779 >2013-12-09 03:17:32,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a65d6e5 >2013-12-09 03:17:32,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: a65d6e5 >2013-12-09 03:17:32,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e1998d2 >2013-12-09 03:17:33,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e1998d2 >2013-12-09 03:17:38,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f5fccf2 >2013-12-09 03:17:38,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f5fccf2 >2013-12-09 03:17:38,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 723d32bc >2013-12-09 03:17:39,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 723d32bc >2013-12-09 03:17:44,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c9b7a8d >2013-12-09 03:17:44,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c9b7a8d >2013-12-09 03:17:44,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30bf4483 >2013-12-09 03:17:44,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30bf4483 >2013-12-09 03:17:49,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54b80acd >2013-12-09 03:17:50,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 54b80acd >2013-12-09 03:17:50,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 610a1c5a >2013-12-09 03:17:50,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 610a1c5a >2013-12-09 03:17:53,773 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-99) No up server in cluster >2013-12-09 03:17:53,773 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-99) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:17:53,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52ba4b49 >2013-12-09 03:17:54,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterTasksListVDSCommand, return: [], log id: 52ba4b49 >2013-12-09 03:17:55,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e3b2ac4 >2013-12-09 03:17:56,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: e3b2ac4 >2013-12-09 03:17:56,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43542aff >2013-12-09 03:17:56,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43542aff >2013-12-09 03:18:01,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7861604f >2013-12-09 03:18:01,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7861604f >2013-12-09 03:18:01,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16ebfc1c >2013-12-09 03:18:02,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16ebfc1c >2013-12-09 03:18:07,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47a0d9e6 >2013-12-09 03:18:07,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 47a0d9e6 >2013-12-09 03:18:07,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19e95a05 >2013-12-09 03:18:07,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19e95a05 >2013-12-09 03:18:12,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c4fbb1e >2013-12-09 03:18:13,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2c4fbb1e >2013-12-09 03:18:13,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d8aa7a1 >2013-12-09 03:18:13,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d8aa7a1 >2013-12-09 03:18:18,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 44b0b707 >2013-12-09 03:18:19,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 44b0b707 >2013-12-09 03:18:19,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 292822d4 >2013-12-09 03:18:19,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 292822d4 >2013-12-09 03:18:24,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f6e78b8 >2013-12-09 03:18:24,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f6e78b8 >2013-12-09 03:18:24,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a459018 >2013-12-09 03:18:25,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a459018 >2013-12-09 03:18:30,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f18781a >2013-12-09 03:18:30,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f18781a >2013-12-09 03:18:30,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3abba290 >2013-12-09 03:18:31,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3abba290 >2013-12-09 03:18:36,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4cb9fd81 >2013-12-09 03:18:36,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4cb9fd81 >2013-12-09 03:18:36,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b2884bb >2013-12-09 03:18:36,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b2884bb >2013-12-09 03:18:41,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 579dea5b >2013-12-09 03:18:42,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 579dea5b >2013-12-09 03:18:42,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1eb40b46 >2013-12-09 03:18:42,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1eb40b46 >2013-12-09 03:18:47,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77bd0c43 >2013-12-09 03:18:48,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 77bd0c43 >2013-12-09 03:18:48,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73e8af65 >2013-12-09 03:18:48,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73e8af65 >2013-12-09 03:18:53,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c7b9d1e >2013-12-09 03:18:53,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c7b9d1e >2013-12-09 03:18:53,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 337a256e >2013-12-09 03:18:54,057 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-62) No up server in cluster >2013-12-09 03:18:54,057 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-62) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:18:54,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d2ac95c >2013-12-09 03:18:54,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 337a256e >2013-12-09 03:18:54,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterTasksListVDSCommand, return: [], log id: d2ac95c >2013-12-09 03:18:59,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6723f6d >2013-12-09 03:18:59,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6723f6d >2013-12-09 03:18:59,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c354159 >2013-12-09 03:18:59,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c354159 >2013-12-09 03:19:04,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1bdab617 >2013-12-09 03:19:05,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1bdab617 >2013-12-09 03:19:05,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5fe99250 >2013-12-09 03:19:05,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fe99250 >2013-12-09 03:19:10,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 683a6b53 >2013-12-09 03:19:11,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 683a6b53 >2013-12-09 03:19:11,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ad77218 >2013-12-09 03:19:11,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ad77218 >2013-12-09 03:19:16,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5252b647 >2013-12-09 03:19:17,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5252b647 >2013-12-09 03:19:17,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2128518f >2013-12-09 03:19:17,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2128518f >2013-12-09 03:19:22,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6df7b5d8 >2013-12-09 03:19:22,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6df7b5d8 >2013-12-09 03:19:22,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ed7f5d7 >2013-12-09 03:19:23,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ed7f5d7 >2013-12-09 03:19:28,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62cf99b7 >2013-12-09 03:19:28,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 62cf99b7 >2013-12-09 03:19:28,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 327b7881 >2013-12-09 03:19:28,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 327b7881 >2013-12-09 03:19:33,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31ab0ee0 >2013-12-09 03:19:34,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 31ab0ee0 >2013-12-09 03:19:34,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 729ba60a >2013-12-09 03:19:34,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 729ba60a >2013-12-09 03:19:39,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 940a05e >2013-12-09 03:19:40,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 940a05e >2013-12-09 03:19:40,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41cfa47a >2013-12-09 03:19:40,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41cfa47a >2013-12-09 03:19:45,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52c41089 >2013-12-09 03:19:45,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 52c41089 >2013-12-09 03:19:45,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 95b7292 >2013-12-09 03:19:46,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 95b7292 >2013-12-09 03:19:51,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21ebb25a >2013-12-09 03:19:51,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 21ebb25a >2013-12-09 03:19:51,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a0aa402 >2013-12-09 03:19:51,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a0aa402 >2013-12-09 03:19:54,328 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-8) No up server in cluster >2013-12-09 03:19:54,329 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-8) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:19:54,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e5c5adb >2013-12-09 03:19:54,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4e5c5adb >2013-12-09 03:19:57,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2958867 >2013-12-09 03:19:57,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2958867 >2013-12-09 03:19:57,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 22ee8c4e >2013-12-09 03:19:57,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22ee8c4e >2013-12-09 03:20:02,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6572da6a >2013-12-09 03:20:03,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6572da6a >2013-12-09 03:20:03,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 530dd71e >2013-12-09 03:20:03,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 530dd71e >2013-12-09 03:20:08,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e5545c6 >2013-12-09 03:20:09,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: e5545c6 >2013-12-09 03:20:09,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6efab928 >2013-12-09 03:20:09,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6efab928 >2013-12-09 03:20:14,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24b596bc >2013-12-09 03:20:14,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 24b596bc >2013-12-09 03:20:14,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77b92293 >2013-12-09 03:20:15,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77b92293 >2013-12-09 03:20:20,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3262f4e5 >2013-12-09 03:20:20,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3262f4e5 >2013-12-09 03:20:20,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7cf9c3c9 >2013-12-09 03:20:20,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7cf9c3c9 >2013-12-09 03:20:25,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1279b3c >2013-12-09 03:20:26,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1279b3c >2013-12-09 03:20:26,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 833d4f5 >2013-12-09 03:20:26,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 833d4f5 >2013-12-09 03:20:31,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c0e2bc9 >2013-12-09 03:20:32,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2c0e2bc9 >2013-12-09 03:20:32,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3be19d3e >2013-12-09 03:20:32,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3be19d3e >2013-12-09 03:20:37,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c7fb34b >2013-12-09 03:20:37,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c7fb34b >2013-12-09 03:20:37,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f89233c >2013-12-09 03:20:38,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f89233c >2013-12-09 03:20:43,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54460f2d >2013-12-09 03:20:43,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 54460f2d >2013-12-09 03:20:43,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63e8633d >2013-12-09 03:20:44,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63e8633d >2013-12-09 03:20:49,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2308db27 >2013-12-09 03:20:49,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2308db27 >2013-12-09 03:20:49,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53d1a6ff >2013-12-09 03:20:49,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53d1a6ff >2013-12-09 03:20:54,618 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) No up server in cluster >2013-12-09 03:20:54,618 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:20:54,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ba8513d >2013-12-09 03:20:54,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 735ad0e9 >2013-12-09 03:20:54,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4ba8513d >2013-12-09 03:20:55,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 735ad0e9 >2013-12-09 03:20:55,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36dab720 >2013-12-09 03:20:55,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36dab720 >2013-12-09 03:21:00,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 523a461e >2013-12-09 03:21:01,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 523a461e >2013-12-09 03:21:01,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53062b53 >2013-12-09 03:21:01,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53062b53 >2013-12-09 03:21:06,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41f48bc2 >2013-12-09 03:21:06,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 41f48bc2 >2013-12-09 03:21:06,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1caaeed3 >2013-12-09 03:21:07,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1caaeed3 >2013-12-09 03:21:12,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b661e82 >2013-12-09 03:21:12,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b661e82 >2013-12-09 03:21:12,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7747f2d7 >2013-12-09 03:21:13,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7747f2d7 >2013-12-09 03:21:18,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74688e57 >2013-12-09 03:21:18,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 74688e57 >2013-12-09 03:21:18,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33368a60 >2013-12-09 03:21:18,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33368a60 >2013-12-09 03:21:23,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17e04d38 >2013-12-09 03:21:24,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 17e04d38 >2013-12-09 03:21:24,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ff2f5fc >2013-12-09 03:21:24,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ff2f5fc >2013-12-09 03:21:29,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48905eaf >2013-12-09 03:21:30,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 48905eaf >2013-12-09 03:21:30,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13257d32 >2013-12-09 03:21:30,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13257d32 >2013-12-09 03:21:35,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 484cbe10 >2013-12-09 03:21:35,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 484cbe10 >2013-12-09 03:21:35,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ba690a3 >2013-12-09 03:21:36,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ba690a3 >2013-12-09 03:21:41,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 85f4a43 >2013-12-09 03:21:41,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 85f4a43 >2013-12-09 03:21:41,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 96f0ec8 >2013-12-09 03:21:41,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 96f0ec8 >2013-12-09 03:21:46,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d96ee14 >2013-12-09 03:21:47,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d96ee14 >2013-12-09 03:21:47,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29221c0b >2013-12-09 03:21:47,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29221c0b >2013-12-09 03:21:52,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7abc7f81 >2013-12-09 03:21:53,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7abc7f81 >2013-12-09 03:21:53,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39f6b271 >2013-12-09 03:21:53,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39f6b271 >2013-12-09 03:21:54,909 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-49) No up server in cluster >2013-12-09 03:21:54,909 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-49) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:21:54,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 681362ee >2013-12-09 03:21:55,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterTasksListVDSCommand, return: [], log id: 681362ee >2013-12-09 03:21:58,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3938b37e >2013-12-09 03:21:58,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3938b37e >2013-12-09 03:21:58,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d0ffe57 >2013-12-09 03:21:59,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d0ffe57 >2013-12-09 03:22:04,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f0e3cfa >2013-12-09 03:22:04,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f0e3cfa >2013-12-09 03:22:04,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1048c8c9 >2013-12-09 03:22:05,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1048c8c9 >2013-12-09 03:22:10,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62442c2a >2013-12-09 03:22:10,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 62442c2a >2013-12-09 03:22:10,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bf33c57 >2013-12-09 03:22:10,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4bf33c57 >2013-12-09 03:22:15,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a42d77 >2013-12-09 03:22:16,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: a42d77 >2013-12-09 03:22:16,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33ecfd6f >2013-12-09 03:22:16,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33ecfd6f >2013-12-09 03:22:21,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c839407 >2013-12-09 03:22:22,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2c839407 >2013-12-09 03:22:22,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30faffce >2013-12-09 03:22:22,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30faffce >2013-12-09 03:22:27,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e2e4274 >2013-12-09 03:22:27,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: e2e4274 >2013-12-09 03:22:27,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f804262 >2013-12-09 03:22:28,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f804262 >2013-12-09 03:22:33,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8d11fba >2013-12-09 03:22:33,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 8d11fba >2013-12-09 03:22:33,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f65a25f >2013-12-09 03:22:33,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f65a25f >2013-12-09 03:22:38,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ade6336 >2013-12-09 03:22:39,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6ade6336 >2013-12-09 03:22:39,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 485c4625 >2013-12-09 03:22:39,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 485c4625 >2013-12-09 03:22:44,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3762993b >2013-12-09 03:22:45,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3762993b >2013-12-09 03:22:45,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d9da564 >2013-12-09 03:22:45,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d9da564 >2013-12-09 03:22:50,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 762c2dba >2013-12-09 03:22:50,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 762c2dba >2013-12-09 03:22:51,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b9d2808 >2013-12-09 03:22:51,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b9d2808 >2013-12-09 03:22:55,196 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) No up server in cluster >2013-12-09 03:22:55,196 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:22:55,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31b36bba >2013-12-09 03:22:55,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterTasksListVDSCommand, return: [], log id: 31b36bba >2013-12-09 03:22:56,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68b47e7e >2013-12-09 03:22:56,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 68b47e7e >2013-12-09 03:22:56,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a61a3f8 >2013-12-09 03:22:57,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a61a3f8 >2013-12-09 03:23:02,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6daee9fb >2013-12-09 03:23:02,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6daee9fb >2013-12-09 03:23:02,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 116f3603 >2013-12-09 03:23:02,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 116f3603 >2013-12-09 03:23:07,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c191a69 >2013-12-09 03:23:08,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c191a69 >2013-12-09 03:23:08,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2775be77 >2013-12-09 03:23:08,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2775be77 >2013-12-09 03:23:13,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 795b0820 >2013-12-09 03:23:14,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 795b0820 >2013-12-09 03:23:14,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 727013e4 >2013-12-09 03:23:14,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 727013e4 >2013-12-09 03:23:19,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51043886 >2013-12-09 03:23:19,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 51043886 >2013-12-09 03:23:19,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ab8d4fc >2013-12-09 03:23:20,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ab8d4fc >2013-12-09 03:23:25,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 735edaec >2013-12-09 03:23:25,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 735edaec >2013-12-09 03:23:25,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: df98ded >2013-12-09 03:23:25,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: df98ded >2013-12-09 03:23:30,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3dba0a7f >2013-12-09 03:23:31,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3dba0a7f >2013-12-09 03:23:31,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 752d3265 >2013-12-09 03:23:31,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 752d3265 >2013-12-09 03:23:36,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73e5db66 >2013-12-09 03:23:37,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 73e5db66 >2013-12-09 03:23:37,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 769ac74e >2013-12-09 03:23:37,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 769ac74e >2013-12-09 03:23:42,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1fb7a3ba >2013-12-09 03:23:43,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1fb7a3ba >2013-12-09 03:23:43,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15895e86 >2013-12-09 03:23:43,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15895e86 >2013-12-09 03:23:48,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 411b5307 >2013-12-09 03:23:48,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 411b5307 >2013-12-09 03:23:48,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b9188c7 >2013-12-09 03:23:49,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b9188c7 >2013-12-09 03:23:54,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13080890 >2013-12-09 03:23:54,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 13080890 >2013-12-09 03:23:54,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5796ae34 >2013-12-09 03:23:54,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5796ae34 >2013-12-09 03:23:55,466 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-23) No up server in cluster >2013-12-09 03:23:55,466 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-23) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:23:55,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66b8cb23 >2013-12-09 03:23:55,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterTasksListVDSCommand, return: [], log id: 66b8cb23 >2013-12-09 03:23:59,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c73dde2 >2013-12-09 03:24:00,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c73dde2 >2013-12-09 03:24:00,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bb172ab >2013-12-09 03:24:00,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bb172ab >2013-12-09 03:24:05,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65a5c3cc >2013-12-09 03:24:06,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 65a5c3cc >2013-12-09 03:24:06,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b9d7031 >2013-12-09 03:24:06,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b9d7031 >2013-12-09 03:24:11,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e5af3ad >2013-12-09 03:24:11,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e5af3ad >2013-12-09 03:24:11,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c3af4be >2013-12-09 03:24:12,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c3af4be >2013-12-09 03:24:17,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6175de60 >2013-12-09 03:24:17,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6175de60 >2013-12-09 03:24:17,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ff4d66a >2013-12-09 03:24:17,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ff4d66a >2013-12-09 03:24:22,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 364aa16 >2013-12-09 03:24:23,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 364aa16 >2013-12-09 03:24:23,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38f8eaa6 >2013-12-09 03:24:23,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38f8eaa6 >2013-12-09 03:24:28,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28b62eef >2013-12-09 03:24:29,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 28b62eef >2013-12-09 03:24:29,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67b1644f >2013-12-09 03:24:29,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67b1644f >2013-12-09 03:24:34,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65a0d8e4 >2013-12-09 03:24:35,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 65a0d8e4 >2013-12-09 03:24:35,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61d28fb8 >2013-12-09 03:24:35,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61d28fb8 >2013-12-09 03:24:40,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 740d4506 >2013-12-09 03:24:40,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 740d4506 >2013-12-09 03:24:40,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f32b90e >2013-12-09 03:24:41,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f32b90e >2013-12-09 03:24:46,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77c54de9 >2013-12-09 03:24:46,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 77c54de9 >2013-12-09 03:24:46,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6aca98e >2013-12-09 03:24:46,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6aca98e >2013-12-09 03:24:51,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21eb186d >2013-12-09 03:24:52,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 21eb186d >2013-12-09 03:24:52,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f1b1e40 >2013-12-09 03:24:52,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f1b1e40 >2013-12-09 03:24:55,736 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-79) No up server in cluster >2013-12-09 03:24:55,737 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-79) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:24:55,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3412702a >2013-12-09 03:24:56,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3412702a >2013-12-09 03:24:57,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39e8bd6 >2013-12-09 03:24:58,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 39e8bd6 >2013-12-09 03:24:58,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64690de8 >2013-12-09 03:24:58,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64690de8 >2013-12-09 03:25:03,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c02bbe1 >2013-12-09 03:25:03,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6c02bbe1 >2013-12-09 03:25:03,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5fdaf87a >2013-12-09 03:25:04,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fdaf87a >2013-12-09 03:25:09,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 736739cb >2013-12-09 03:25:09,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 736739cb >2013-12-09 03:25:09,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21dd65ed >2013-12-09 03:25:09,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21dd65ed >2013-12-09 03:25:14,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a3aef88 >2013-12-09 03:25:15,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4a3aef88 >2013-12-09 03:25:15,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ffa149a >2013-12-09 03:25:15,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ffa149a >2013-12-09 03:25:20,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e0a415b >2013-12-09 03:25:21,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6e0a415b >2013-12-09 03:25:21,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54419df8 >2013-12-09 03:25:21,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54419df8 >2013-12-09 03:25:26,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68634c02 >2013-12-09 03:25:26,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 68634c02 >2013-12-09 03:25:26,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 591dd74f >2013-12-09 03:25:27,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 591dd74f >2013-12-09 03:25:32,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b1126 >2013-12-09 03:25:32,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4b1126 >2013-12-09 03:25:32,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 674e6d90 >2013-12-09 03:25:33,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 674e6d90 >2013-12-09 03:25:38,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76b41975 >2013-12-09 03:25:38,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 76b41975 >2013-12-09 03:25:38,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c51f21f >2013-12-09 03:25:38,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c51f21f >2013-12-09 03:25:43,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75a0ab94 >2013-12-09 03:25:44,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 75a0ab94 >2013-12-09 03:25:44,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51598e7 >2013-12-09 03:25:44,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51598e7 >2013-12-09 03:25:49,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69c6ab2a >2013-12-09 03:25:50,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 69c6ab2a >2013-12-09 03:25:50,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c53f375 >2013-12-09 03:25:50,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c53f375 >2013-12-09 03:25:55,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 332deaa >2013-12-09 03:25:55,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 332deaa >2013-12-09 03:25:55,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6fad056c >2013-12-09 03:25:56,025 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-48) No up server in cluster >2013-12-09 03:25:56,025 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-48) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:25:56,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d6a2091 >2013-12-09 03:25:56,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6fad056c >2013-12-09 03:25:56,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4d6a2091 >2013-12-09 03:26:01,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5836487b >2013-12-09 03:26:01,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5836487b >2013-12-09 03:26:01,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4fb538e5 >2013-12-09 03:26:01,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fb538e5 >2013-12-09 03:26:06,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 720c357 >2013-12-09 03:26:07,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 720c357 >2013-12-09 03:26:07,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 434db4fd >2013-12-09 03:26:07,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 434db4fd >2013-12-09 03:26:12,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4874e1cb >2013-12-09 03:26:13,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4874e1cb >2013-12-09 03:26:13,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42cecd92 >2013-12-09 03:26:13,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42cecd92 >2013-12-09 03:26:18,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 634b53fd >2013-12-09 03:26:18,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 634b53fd >2013-12-09 03:26:18,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50db7b08 >2013-12-09 03:26:19,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50db7b08 >2013-12-09 03:26:24,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 383eac47 >2013-12-09 03:26:24,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 383eac47 >2013-12-09 03:26:24,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 789943b5 >2013-12-09 03:26:24,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 789943b5 >2013-12-09 03:26:29,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3364fc33 >2013-12-09 03:26:30,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3364fc33 >2013-12-09 03:26:30,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f0664eb >2013-12-09 03:26:30,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f0664eb >2013-12-09 03:26:35,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1816e5e8 >2013-12-09 03:26:36,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1816e5e8 >2013-12-09 03:26:36,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 519eeeab >2013-12-09 03:26:36,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 519eeeab >2013-12-09 03:26:41,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18a09ef5 >2013-12-09 03:26:42,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 18a09ef5 >2013-12-09 03:26:42,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39c48618 >2013-12-09 03:26:42,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39c48618 >2013-12-09 03:26:47,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 312308d3 >2013-12-09 03:26:47,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 312308d3 >2013-12-09 03:26:47,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1eaef1d5 >2013-12-09 03:26:48,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1eaef1d5 >2013-12-09 03:26:53,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c6af26e >2013-12-09 03:26:53,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c6af26e >2013-12-09 03:26:53,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 247f83c >2013-12-09 03:26:53,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 247f83c >2013-12-09 03:26:56,295 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-82) No up server in cluster >2013-12-09 03:26:56,295 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-82) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:26:56,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 158c10d3 >2013-12-09 03:26:56,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterTasksListVDSCommand, return: [], log id: 158c10d3 >2013-12-09 03:26:58,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6bc62c83 >2013-12-09 03:26:59,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6bc62c83 >2013-12-09 03:26:59,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50f5c651 >2013-12-09 03:26:59,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50f5c651 >2013-12-09 03:27:04,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29fbe139 >2013-12-09 03:27:05,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 29fbe139 >2013-12-09 03:27:05,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f0999a9 >2013-12-09 03:27:05,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f0999a9 >2013-12-09 03:27:10,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 165cb161 >2013-12-09 03:27:10,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 165cb161 >2013-12-09 03:27:10,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ab1b298 >2013-12-09 03:27:11,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ab1b298 >2013-12-09 03:27:16,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10d1bd46 >2013-12-09 03:27:16,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 10d1bd46 >2013-12-09 03:27:16,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e6a59d9 >2013-12-09 03:27:17,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e6a59d9 >2013-12-09 03:27:22,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6be81773 >2013-12-09 03:27:22,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6be81773 >2013-12-09 03:27:22,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74b4e462 >2013-12-09 03:27:22,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74b4e462 >2013-12-09 03:27:27,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7affd3de >2013-12-09 03:27:28,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7affd3de >2013-12-09 03:27:28,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3fc5fb7a >2013-12-09 03:27:28,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3fc5fb7a >2013-12-09 03:27:33,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ed5921b >2013-12-09 03:27:34,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7ed5921b >2013-12-09 03:27:34,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 195e71db >2013-12-09 03:27:34,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 195e71db >2013-12-09 03:27:39,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13443162 >2013-12-09 03:27:39,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 13443162 >2013-12-09 03:27:39,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f127868 >2013-12-09 03:27:40,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f127868 >2013-12-09 03:27:45,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 766cc507 >2013-12-09 03:27:45,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 766cc507 >2013-12-09 03:27:45,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39f83d9f >2013-12-09 03:27:45,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39f83d9f >2013-12-09 03:27:50,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3cf512ea >2013-12-09 03:27:51,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3cf512ea >2013-12-09 03:27:51,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b8b27f1 >2013-12-09 03:27:51,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b8b27f1 >2013-12-09 03:27:56,567 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-89) No up server in cluster >2013-12-09 03:27:56,567 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-89) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:27:56,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68081814 >2013-12-09 03:27:56,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3484b143 >2013-12-09 03:27:56,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterTasksListVDSCommand, return: [], log id: 68081814 >2013-12-09 03:27:57,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3484b143 >2013-12-09 03:27:57,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b6f5923 >2013-12-09 03:27:57,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b6f5923 >2013-12-09 03:28:02,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1040d448 >2013-12-09 03:28:03,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1040d448 >2013-12-09 03:28:03,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35aff1e7 >2013-12-09 03:28:03,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35aff1e7 >2013-12-09 03:28:08,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51333964 >2013-12-09 03:28:08,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 51333964 >2013-12-09 03:28:08,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45437ecb >2013-12-09 03:28:09,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45437ecb >2013-12-09 03:28:14,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d2a2b66 >2013-12-09 03:28:14,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d2a2b66 >2013-12-09 03:28:14,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5dd4baa6 >2013-12-09 03:28:14,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5dd4baa6 >2013-12-09 03:28:19,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26f07762 >2013-12-09 03:28:20,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 26f07762 >2013-12-09 03:28:20,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 255ee4df >2013-12-09 03:28:20,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 255ee4df >2013-12-09 03:28:25,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20fbcda6 >2013-12-09 03:28:26,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 20fbcda6 >2013-12-09 03:28:26,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 621fcfd9 >2013-12-09 03:28:26,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 621fcfd9 >2013-12-09 03:28:31,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17b2a094 >2013-12-09 03:28:31,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 17b2a094 >2013-12-09 03:28:31,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c330b77 >2013-12-09 03:28:32,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c330b77 >2013-12-09 03:28:37,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 49d6118f >2013-12-09 03:28:37,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 49d6118f >2013-12-09 03:28:37,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 429b9efa >2013-12-09 03:28:37,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 429b9efa >2013-12-09 03:28:42,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69d4f141 >2013-12-09 03:28:43,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 69d4f141 >2013-12-09 03:28:43,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e5c62f6 >2013-12-09 03:28:43,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e5c62f6 >2013-12-09 03:28:48,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30647238 >2013-12-09 03:28:49,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 30647238 >2013-12-09 03:28:49,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11a9f5b >2013-12-09 03:28:49,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11a9f5b >2013-12-09 03:28:54,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 798b361c >2013-12-09 03:28:55,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 798b361c >2013-12-09 03:28:55,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59375850 >2013-12-09 03:28:55,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59375850 >2013-12-09 03:28:56,851 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-1) No up server in cluster >2013-12-09 03:28:56,851 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-1) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:28:56,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 214655da >2013-12-09 03:28:57,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterTasksListVDSCommand, return: [], log id: 214655da >2013-12-09 03:29:00,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69e14a44 >2013-12-09 03:29:00,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 69e14a44 >2013-12-09 03:29:00,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74a7bedc >2013-12-09 03:29:01,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74a7bedc >2013-12-09 03:29:06,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 544ad62b >2013-12-09 03:29:06,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 544ad62b >2013-12-09 03:29:06,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62402f3d >2013-12-09 03:29:06,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62402f3d >2013-12-09 03:29:11,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b526a97 >2013-12-09 03:29:12,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b526a97 >2013-12-09 03:29:12,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f808fb7 >2013-12-09 03:29:12,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f808fb7 >2013-12-09 03:29:17,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53ce20c6 >2013-12-09 03:29:18,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 53ce20c6 >2013-12-09 03:29:18,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 44aff8f1 >2013-12-09 03:29:18,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44aff8f1 >2013-12-09 03:29:23,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 709ed0f2 >2013-12-09 03:29:24,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 709ed0f2 >2013-12-09 03:29:24,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d549650 >2013-12-09 03:29:24,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d549650 >2013-12-09 03:29:29,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78b69372 >2013-12-09 03:29:29,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 78b69372 >2013-12-09 03:29:29,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d148c5a >2013-12-09 03:29:30,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d148c5a >2013-12-09 03:29:35,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 183299e6 >2013-12-09 03:29:35,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 183299e6 >2013-12-09 03:29:35,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 327d580 >2013-12-09 03:29:35,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 327d580 >2013-12-09 03:29:40,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43d17dc9 >2013-12-09 03:29:41,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 43d17dc9 >2013-12-09 03:29:41,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f21a316 >2013-12-09 03:29:41,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f21a316 >2013-12-09 03:29:46,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fd120f5 >2013-12-09 03:29:47,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2fd120f5 >2013-12-09 03:29:47,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d6c3426 >2013-12-09 03:29:47,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d6c3426 >2013-12-09 03:29:52,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f68c54 >2013-12-09 03:29:52,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f68c54 >2013-12-09 03:29:52,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53566dff >2013-12-09 03:29:53,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53566dff >2013-12-09 03:29:57,127 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-81) No up server in cluster >2013-12-09 03:29:57,127 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-81) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:29:57,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10bdfdb >2013-12-09 03:29:57,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterTasksListVDSCommand, return: [], log id: 10bdfdb >2013-12-09 03:29:58,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18c53e01 >2013-12-09 03:29:58,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 18c53e01 >2013-12-09 03:29:58,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5fabd2af >2013-12-09 03:29:58,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fabd2af >2013-12-09 03:30:03,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 594b08e8 >2013-12-09 03:30:04,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 594b08e8 >2013-12-09 03:30:04,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41cce991 >2013-12-09 03:30:04,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41cce991 >2013-12-09 03:30:09,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c8d621a >2013-12-09 03:30:10,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3c8d621a >2013-12-09 03:30:10,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79381a93 >2013-12-09 03:30:10,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79381a93 >2013-12-09 03:30:15,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c02f31b >2013-12-09 03:30:16,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c02f31b >2013-12-09 03:30:16,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c1eae64 >2013-12-09 03:30:16,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c1eae64 >2013-12-09 03:30:21,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2aa7dfcf >2013-12-09 03:30:21,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2aa7dfcf >2013-12-09 03:30:21,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 357847db >2013-12-09 03:30:22,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 357847db >2013-12-09 03:30:27,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 693be36 >2013-12-09 03:30:27,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 693be36 >2013-12-09 03:30:27,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4426d698 >2013-12-09 03:30:27,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4426d698 >2013-12-09 03:30:32,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1fb4d0b2 >2013-12-09 03:30:33,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1fb4d0b2 >2013-12-09 03:30:33,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a50484b >2013-12-09 03:30:33,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a50484b >2013-12-09 03:30:38,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72aad2fb >2013-12-09 03:30:39,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 72aad2fb >2013-12-09 03:30:39,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ab8deb7 >2013-12-09 03:30:39,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ab8deb7 >2013-12-09 03:30:44,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d0ddf68 >2013-12-09 03:30:44,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d0ddf68 >2013-12-09 03:30:44,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 402cf5f5 >2013-12-09 03:30:45,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 402cf5f5 >2013-12-09 03:30:50,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8a3ef13 >2013-12-09 03:30:50,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 8a3ef13 >2013-12-09 03:30:50,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e4aaf4f >2013-12-09 03:30:51,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e4aaf4f >2013-12-09 03:30:56,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38643883 >2013-12-09 03:30:56,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 38643883 >2013-12-09 03:30:56,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54a87a3e >2013-12-09 03:30:56,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54a87a3e >2013-12-09 03:30:57,412 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-77) No up server in cluster >2013-12-09 03:30:57,412 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-77) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:30:57,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a355ffb >2013-12-09 03:30:57,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2a355ffb >2013-12-09 03:31:01,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79a8e047 >2013-12-09 03:31:02,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 79a8e047 >2013-12-09 03:31:02,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b7f7653 >2013-12-09 03:31:02,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b7f7653 >2013-12-09 03:31:07,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 489a160a >2013-12-09 03:31:08,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 489a160a >2013-12-09 03:31:08,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78788703 >2013-12-09 03:31:08,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78788703 >2013-12-09 03:31:13,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76ef35ed >2013-12-09 03:31:13,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 76ef35ed >2013-12-09 03:31:13,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a81a7fa >2013-12-09 03:31:14,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a81a7fa >2013-12-09 03:31:19,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 127dc257 >2013-12-09 03:31:19,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 127dc257 >2013-12-09 03:31:19,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8e16c98 >2013-12-09 03:31:19,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8e16c98 >2013-12-09 03:31:24,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 115a39c9 >2013-12-09 03:31:25,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 115a39c9 >2013-12-09 03:31:25,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2506a35d >2013-12-09 03:31:25,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2506a35d >2013-12-09 03:31:30,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f2c01 >2013-12-09 03:31:31,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f2c01 >2013-12-09 03:31:31,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62c29aa >2013-12-09 03:31:31,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62c29aa >2013-12-09 03:31:36,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a64baf0 >2013-12-09 03:31:37,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3a64baf0 >2013-12-09 03:31:37,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7df0fbb4 >2013-12-09 03:31:37,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7df0fbb4 >2013-12-09 03:31:42,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40273157 >2013-12-09 03:31:42,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 40273157 >2013-12-09 03:31:42,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ed13435 >2013-12-09 03:31:43,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ed13435 >2013-12-09 03:31:48,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f9cff27 >2013-12-09 03:31:48,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f9cff27 >2013-12-09 03:31:48,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a3aedc >2013-12-09 03:31:48,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a3aedc >2013-12-09 03:31:53,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3fba1db6 >2013-12-09 03:31:54,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3fba1db6 >2013-12-09 03:31:54,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 719a77f7 >2013-12-09 03:31:54,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 719a77f7 >2013-12-09 03:31:57,689 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-97) No up server in cluster >2013-12-09 03:31:57,689 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-97) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:31:57,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f047d48 >2013-12-09 03:31:57,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6f047d48 >2013-12-09 03:31:59,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 468a5091 >2013-12-09 03:32:00,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 468a5091 >2013-12-09 03:32:00,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26af7a1a >2013-12-09 03:32:00,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26af7a1a >2013-12-09 03:32:05,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67f9841f >2013-12-09 03:32:05,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 67f9841f >2013-12-09 03:32:05,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1367aab9 >2013-12-09 03:32:06,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1367aab9 >2013-12-09 03:32:11,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7788dd65 >2013-12-09 03:32:11,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7788dd65 >2013-12-09 03:32:11,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7dd56802 >2013-12-09 03:32:11,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7dd56802 >2013-12-09 03:32:16,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21365c00 >2013-12-09 03:32:17,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 21365c00 >2013-12-09 03:32:17,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54ef92cf >2013-12-09 03:32:17,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54ef92cf >2013-12-09 03:32:22,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1faa894e >2013-12-09 03:32:23,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1faa894e >2013-12-09 03:32:23,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1690d2db >2013-12-09 03:32:23,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1690d2db >2013-12-09 03:32:28,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ba9ce78 >2013-12-09 03:32:29,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6ba9ce78 >2013-12-09 03:32:29,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7acecd3a >2013-12-09 03:32:29,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7acecd3a >2013-12-09 03:32:34,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58fed54f >2013-12-09 03:32:34,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 58fed54f >2013-12-09 03:32:34,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72c65891 >2013-12-09 03:32:35,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72c65891 >2013-12-09 03:32:40,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e80e3ff >2013-12-09 03:32:40,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3e80e3ff >2013-12-09 03:32:40,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 231c7ae8 >2013-12-09 03:32:40,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 231c7ae8 >2013-12-09 03:32:45,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a187b8d >2013-12-09 03:32:46,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4a187b8d >2013-12-09 03:32:46,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21e11222 >2013-12-09 03:32:46,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21e11222 >2013-12-09 03:32:51,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 680ce68e >2013-12-09 03:32:52,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 680ce68e >2013-12-09 03:32:52,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15b4e315 >2013-12-09 03:32:52,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15b4e315 >2013-12-09 03:32:57,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65258e60 >2013-12-09 03:32:57,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 65258e60 >2013-12-09 03:32:57,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41794259 >2013-12-09 03:32:57,965 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-25) No up server in cluster >2013-12-09 03:32:57,965 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-25) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:32:57,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7fb79134 >2013-12-09 03:32:58,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41794259 >2013-12-09 03:32:58,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7fb79134 >2013-12-09 03:33:03,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c108886 >2013-12-09 03:33:03,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c108886 >2013-12-09 03:33:03,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 243f6c63 >2013-12-09 03:33:03,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 243f6c63 >2013-12-09 03:33:08,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61d0f119 >2013-12-09 03:33:09,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 61d0f119 >2013-12-09 03:33:09,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e0e7fa9 >2013-12-09 03:33:09,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e0e7fa9 >2013-12-09 03:33:14,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70d6d2a8 >2013-12-09 03:33:15,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 70d6d2a8 >2013-12-09 03:33:15,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43d00828 >2013-12-09 03:33:15,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43d00828 >2013-12-09 03:33:20,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f58e19d >2013-12-09 03:33:21,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3f58e19d >2013-12-09 03:33:21,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ff74e3 >2013-12-09 03:33:21,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ff74e3 >2013-12-09 03:33:26,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 14ad9106 >2013-12-09 03:33:26,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 14ad9106 >2013-12-09 03:33:26,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f7a807b >2013-12-09 03:33:27,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f7a807b >2013-12-09 03:33:32,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 259e2879 >2013-12-09 03:33:32,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 259e2879 >2013-12-09 03:33:32,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18e14ded >2013-12-09 03:33:32,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18e14ded >2013-12-09 03:33:37,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e6a9add >2013-12-09 03:33:38,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e6a9add >2013-12-09 03:33:38,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3844a0bf >2013-12-09 03:33:38,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3844a0bf >2013-12-09 03:33:43,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41c6112a >2013-12-09 03:33:44,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 41c6112a >2013-12-09 03:33:44,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 233a3d93 >2013-12-09 03:33:44,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 233a3d93 >2013-12-09 03:33:49,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e4aa17a >2013-12-09 03:33:49,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e4aa17a >2013-12-09 03:33:49,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 742ae9c >2013-12-09 03:33:50,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 742ae9c >2013-12-09 03:33:55,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3cb86921 >2013-12-09 03:33:55,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3cb86921 >2013-12-09 03:33:55,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e0162fb >2013-12-09 03:33:56,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e0162fb >2013-12-09 03:33:58,235 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) No up server in cluster >2013-12-09 03:33:58,235 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:33:58,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7352c7ae >2013-12-09 03:33:58,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7352c7ae >2013-12-09 03:34:01,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b2fd8f >2013-12-09 03:34:01,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1b2fd8f >2013-12-09 03:34:01,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38ff1521 >2013-12-09 03:34:01,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38ff1521 >2013-12-09 03:34:06,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f9076ac >2013-12-09 03:34:07,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: f9076ac >2013-12-09 03:34:07,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 790aa1ad >2013-12-09 03:34:07,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 790aa1ad >2013-12-09 03:34:12,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 313d2449 >2013-12-09 03:34:13,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 313d2449 >2013-12-09 03:34:13,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b6c6987 >2013-12-09 03:34:13,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b6c6987 >2013-12-09 03:34:18,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3745830a >2013-12-09 03:34:18,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3745830a >2013-12-09 03:34:18,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26a7cbc1 >2013-12-09 03:34:19,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26a7cbc1 >2013-12-09 03:34:24,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60c383dc >2013-12-09 03:34:24,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 60c383dc >2013-12-09 03:34:24,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f090ee7 >2013-12-09 03:34:24,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f090ee7 >2013-12-09 03:34:29,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 408b939a >2013-12-09 03:34:30,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 408b939a >2013-12-09 03:34:30,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7149569f >2013-12-09 03:34:30,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7149569f >2013-12-09 03:34:35,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e20cc6d >2013-12-09 03:34:36,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e20cc6d >2013-12-09 03:34:36,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ce9cb7c >2013-12-09 03:34:36,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ce9cb7c >2013-12-09 03:34:41,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58e102dd >2013-12-09 03:34:41,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 58e102dd >2013-12-09 03:34:41,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2360646b >2013-12-09 03:34:42,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2360646b >2013-12-09 03:34:47,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c194f25 >2013-12-09 03:34:47,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c194f25 >2013-12-09 03:34:47,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38c56b9e >2013-12-09 03:34:48,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38c56b9e >2013-12-09 03:34:53,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67490be0 >2013-12-09 03:34:53,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 67490be0 >2013-12-09 03:34:53,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5132547a >2013-12-09 03:34:53,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5132547a >2013-12-09 03:34:58,507 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-70) No up server in cluster >2013-12-09 03:34:58,508 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-70) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:34:58,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e8d76e8 >2013-12-09 03:34:58,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1e8d76e8 >2013-12-09 03:34:58,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 507de1aa >2013-12-09 03:34:59,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 507de1aa >2013-12-09 03:34:59,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f87b3ec >2013-12-09 03:34:59,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f87b3ec >2013-12-09 03:35:04,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f6b3795 >2013-12-09 03:35:05,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f6b3795 >2013-12-09 03:35:05,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76b67e9b >2013-12-09 03:35:05,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76b67e9b >2013-12-09 03:35:10,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b5f0469 >2013-12-09 03:35:10,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: b5f0469 >2013-12-09 03:35:10,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 148adfce >2013-12-09 03:35:11,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 148adfce >2013-12-09 03:35:16,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20717a5d >2013-12-09 03:35:16,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 20717a5d >2013-12-09 03:35:16,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44f25437 >2013-12-09 03:35:16,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44f25437 >2013-12-09 03:35:21,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ae39cef >2013-12-09 03:35:22,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ae39cef >2013-12-09 03:35:22,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6de6edb2 >2013-12-09 03:35:22,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6de6edb2 >2013-12-09 03:35:27,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d33c400 >2013-12-09 03:35:28,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4d33c400 >2013-12-09 03:35:28,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ee3da04 >2013-12-09 03:35:28,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ee3da04 >2013-12-09 03:35:33,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 278f5e78 >2013-12-09 03:35:33,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 278f5e78 >2013-12-09 03:35:33,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47d087a2 >2013-12-09 03:35:34,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47d087a2 >2013-12-09 03:35:35,001 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-67) Start deleteAgedOutAuditLogs >2013-12-09 03:35:35,006 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-67) Finished deleteAgedOutAuditLogs >2013-12-09 03:35:39,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a0fb393 >2013-12-09 03:35:39,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a0fb393 >2013-12-09 03:35:39,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d0f4d28 >2013-12-09 03:35:40,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d0f4d28 >2013-12-09 03:35:45,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60a9d6a6 >2013-12-09 03:35:45,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 60a9d6a6 >2013-12-09 03:35:45,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4121ea57 >2013-12-09 03:35:45,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4121ea57 >2013-12-09 03:35:50,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27d6bdc3 >2013-12-09 03:35:51,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 27d6bdc3 >2013-12-09 03:35:51,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31b6d08c >2013-12-09 03:35:51,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31b6d08c >2013-12-09 03:35:56,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9068050 >2013-12-09 03:35:57,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 9068050 >2013-12-09 03:35:57,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2923be0a >2013-12-09 03:35:57,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2923be0a >2013-12-09 03:35:58,790 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-31) No up server in cluster >2013-12-09 03:35:58,791 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-31) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:35:58,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a2874e9 >2013-12-09 03:35:59,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7a2874e9 >2013-12-09 03:36:02,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ab932e6 >2013-12-09 03:36:02,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: ab932e6 >2013-12-09 03:36:02,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2dddd225 >2013-12-09 03:36:03,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2dddd225 >2013-12-09 03:36:08,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6bb692ed >2013-12-09 03:36:08,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6bb692ed >2013-12-09 03:36:08,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6fb7a76c >2013-12-09 03:36:08,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6fb7a76c >2013-12-09 03:36:13,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53839cdf >2013-12-09 03:36:14,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 53839cdf >2013-12-09 03:36:14,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 22f50a5a >2013-12-09 03:36:14,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22f50a5a >2013-12-09 03:36:19,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ab9535e >2013-12-09 03:36:20,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ab9535e >2013-12-09 03:36:20,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 223e1520 >2013-12-09 03:36:20,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 223e1520 >2013-12-09 03:36:25,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6941793c >2013-12-09 03:36:25,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6941793c >2013-12-09 03:36:25,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4201db10 >2013-12-09 03:36:26,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4201db10 >2013-12-09 03:36:31,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bcef4f5 >2013-12-09 03:36:31,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1bcef4f5 >2013-12-09 03:36:31,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f7c6851 >2013-12-09 03:36:32,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f7c6851 >2013-12-09 03:36:37,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77936fd9 >2013-12-09 03:36:37,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 77936fd9 >2013-12-09 03:36:37,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ae0532d >2013-12-09 03:36:37,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ae0532d >2013-12-09 03:36:42,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4118054f >2013-12-09 03:36:43,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4118054f >2013-12-09 03:36:43,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 234cae7c >2013-12-09 03:36:43,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 234cae7c >2013-12-09 03:36:48,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c44f745 >2013-12-09 03:36:49,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4c44f745 >2013-12-09 03:36:49,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ddf27e >2013-12-09 03:36:49,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ddf27e >2013-12-09 03:36:54,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d934cd0 >2013-12-09 03:36:54,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: d934cd0 >2013-12-09 03:36:54,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5471b128 >2013-12-09 03:36:55,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5471b128 >2013-12-09 03:36:59,068 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-2) No up server in cluster >2013-12-09 03:36:59,068 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-2) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:36:59,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a90df4e >2013-12-09 03:36:59,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2a90df4e >2013-12-09 03:37:00,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 270c9adc >2013-12-09 03:37:00,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 270c9adc >2013-12-09 03:37:00,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ea5c59b >2013-12-09 03:37:00,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ea5c59b >2013-12-09 03:37:05,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ef5e88 >2013-12-09 03:37:06,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3ef5e88 >2013-12-09 03:37:06,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3747239d >2013-12-09 03:37:06,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3747239d >2013-12-09 03:37:11,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b5ee55e >2013-12-09 03:37:12,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b5ee55e >2013-12-09 03:37:12,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72edc104 >2013-12-09 03:37:12,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72edc104 >2013-12-09 03:37:17,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a55600b >2013-12-09 03:37:17,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: a55600b >2013-12-09 03:37:17,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ee2ac55 >2013-12-09 03:37:18,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ee2ac55 >2013-12-09 03:37:23,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 741dc04 >2013-12-09 03:37:23,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 741dc04 >2013-12-09 03:37:23,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b97c460 >2013-12-09 03:37:23,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b97c460 >2013-12-09 03:37:28,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d000c2f >2013-12-09 03:37:29,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d000c2f >2013-12-09 03:37:29,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ad97628 >2013-12-09 03:37:29,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ad97628 >2013-12-09 03:37:34,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65de3e08 >2013-12-09 03:37:35,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 65de3e08 >2013-12-09 03:37:35,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36b24f4e >2013-12-09 03:37:35,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36b24f4e >2013-12-09 03:37:40,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66357088 >2013-12-09 03:37:40,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 66357088 >2013-12-09 03:37:40,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 427d9f6e >2013-12-09 03:37:41,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 427d9f6e >2013-12-09 03:37:46,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c1044f6 >2013-12-09 03:37:46,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1c1044f6 >2013-12-09 03:37:46,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53cbabe4 >2013-12-09 03:37:46,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53cbabe4 >2013-12-09 03:37:51,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a92d3f >2013-12-09 03:37:52,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: a92d3f >2013-12-09 03:37:52,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d91b8cb >2013-12-09 03:37:52,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d91b8cb >2013-12-09 03:37:57,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 379359d0 >2013-12-09 03:37:58,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 379359d0 >2013-12-09 03:37:58,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2fa42d3d >2013-12-09 03:37:58,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2fa42d3d >2013-12-09 03:37:59,335 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) No up server in cluster >2013-12-09 03:37:59,335 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:37:59,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10a2c3d4 >2013-12-09 03:37:59,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterTasksListVDSCommand, return: [], log id: 10a2c3d4 >2013-12-09 03:38:03,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50c6f877 >2013-12-09 03:38:04,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 50c6f877 >2013-12-09 03:38:04,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 715e6f62 >2013-12-09 03:38:04,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 715e6f62 >2013-12-09 03:38:09,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b58402a >2013-12-09 03:38:09,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b58402a >2013-12-09 03:38:09,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12ec0b5a >2013-12-09 03:38:10,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12ec0b5a >2013-12-09 03:38:15,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3471bcf4 >2013-12-09 03:38:15,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3471bcf4 >2013-12-09 03:38:15,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 367e968c >2013-12-09 03:38:15,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 367e968c >2013-12-09 03:38:20,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a5d28c6 >2013-12-09 03:38:21,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a5d28c6 >2013-12-09 03:38:21,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ddfc2ef >2013-12-09 03:38:21,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ddfc2ef >2013-12-09 03:38:26,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37b067ba >2013-12-09 03:38:27,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 37b067ba >2013-12-09 03:38:27,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c9c61db >2013-12-09 03:38:27,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c9c61db >2013-12-09 03:38:32,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6eee05ac >2013-12-09 03:38:32,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6eee05ac >2013-12-09 03:38:32,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34699b0b >2013-12-09 03:38:33,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34699b0b >2013-12-09 03:38:38,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41a5ada0 >2013-12-09 03:38:38,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 41a5ada0 >2013-12-09 03:38:38,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 266ba2ad >2013-12-09 03:38:38,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 266ba2ad >2013-12-09 03:38:43,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3681b15c >2013-12-09 03:38:44,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3681b15c >2013-12-09 03:38:44,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1aa3390 >2013-12-09 03:38:44,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1aa3390 >2013-12-09 03:38:49,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 22f9bc37 >2013-12-09 03:38:50,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 22f9bc37 >2013-12-09 03:38:50,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30fb76ac >2013-12-09 03:38:50,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30fb76ac >2013-12-09 03:38:55,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 554d02de >2013-12-09 03:38:56,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 554d02de >2013-12-09 03:38:56,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34283afa >2013-12-09 03:38:56,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34283afa >2013-12-09 03:38:59,607 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-63) No up server in cluster >2013-12-09 03:38:59,607 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-63) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:38:59,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5be5ed2c >2013-12-09 03:38:59,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5be5ed2c >2013-12-09 03:39:01,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 684d47d3 >2013-12-09 03:39:01,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 684d47d3 >2013-12-09 03:39:01,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e0765c3 >2013-12-09 03:39:02,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e0765c3 >2013-12-09 03:39:07,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 24e45640 >2013-12-09 03:39:07,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 24e45640 >2013-12-09 03:39:07,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d827f3b >2013-12-09 03:39:07,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d827f3b >2013-12-09 03:39:12,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31c695de >2013-12-09 03:39:13,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 31c695de >2013-12-09 03:39:13,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36263703 >2013-12-09 03:39:13,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36263703 >2013-12-09 03:39:18,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2eb3cd90 >2013-12-09 03:39:19,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2eb3cd90 >2013-12-09 03:39:19,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ddaf270 >2013-12-09 03:39:19,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ddaf270 >2013-12-09 03:39:24,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 259a9ee7 >2013-12-09 03:39:24,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 259a9ee7 >2013-12-09 03:39:24,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a1f5695 >2013-12-09 03:39:25,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a1f5695 >2013-12-09 03:39:30,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 154af5b7 >2013-12-09 03:39:30,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 154af5b7 >2013-12-09 03:39:30,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2185bd3d >2013-12-09 03:39:30,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2185bd3d >2013-12-09 03:39:35,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ad455c2 >2013-12-09 03:39:36,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3ad455c2 >2013-12-09 03:39:36,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41267c9b >2013-12-09 03:39:36,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41267c9b >2013-12-09 03:39:41,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b668c8f >2013-12-09 03:39:42,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b668c8f >2013-12-09 03:39:42,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3cc889da >2013-12-09 03:39:42,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3cc889da >2013-12-09 03:39:47,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4875edda >2013-12-09 03:39:48,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4875edda >2013-12-09 03:39:48,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c926f3b >2013-12-09 03:39:48,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c926f3b >2013-12-09 03:39:53,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2aef2946 >2013-12-09 03:39:53,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2aef2946 >2013-12-09 03:39:53,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 498dde4b >2013-12-09 03:39:54,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 498dde4b >2013-12-09 03:39:59,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35dc004e >2013-12-09 03:39:59,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 35dc004e >2013-12-09 03:39:59,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 497cdb6e >2013-12-09 03:39:59,877 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-3) [6d1f044] No up server in cluster >2013-12-09 03:39:59,878 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-3) [6d1f044] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:39:59,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77bc913c >2013-12-09 03:39:59,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 497cdb6e >2013-12-09 03:40:00,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterTasksListVDSCommand, return: [], log id: 77bc913c >2013-12-09 03:40:04,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54b6f65e >2013-12-09 03:40:05,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 54b6f65e >2013-12-09 03:40:05,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c483896 >2013-12-09 03:40:05,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c483896 >2013-12-09 03:40:10,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78133ccf >2013-12-09 03:40:11,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 78133ccf >2013-12-09 03:40:11,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 894457b >2013-12-09 03:40:11,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 894457b >2013-12-09 03:40:16,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1606feed >2013-12-09 03:40:16,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1606feed >2013-12-09 03:40:16,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a26e2fe >2013-12-09 03:40:17,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a26e2fe >2013-12-09 03:40:22,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 300b9cdb >2013-12-09 03:40:22,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 300b9cdb >2013-12-09 03:40:22,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1825f631 >2013-12-09 03:40:22,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1825f631 >2013-12-09 03:40:27,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19122d18 >2013-12-09 03:40:28,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 19122d18 >2013-12-09 03:40:28,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2958ef4 >2013-12-09 03:40:28,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2958ef4 >2013-12-09 03:40:33,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b6a1791 >2013-12-09 03:40:34,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b6a1791 >2013-12-09 03:40:34,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42db5aca >2013-12-09 03:40:34,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42db5aca >2013-12-09 03:40:39,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5276140 >2013-12-09 03:40:40,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5276140 >2013-12-09 03:40:40,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e550bc2 >2013-12-09 03:40:40,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e550bc2 >2013-12-09 03:40:45,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a5f27e3 >2013-12-09 03:40:45,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6a5f27e3 >2013-12-09 03:40:45,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7949baa9 >2013-12-09 03:40:46,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7949baa9 >2013-12-09 03:40:51,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ec2a02 >2013-12-09 03:40:51,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ec2a02 >2013-12-09 03:40:51,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39a3405f >2013-12-09 03:40:51,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39a3405f >2013-12-09 03:40:56,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2bfb7bf0 >2013-12-09 03:40:57,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2bfb7bf0 >2013-12-09 03:40:57,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4770301a >2013-12-09 03:40:57,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4770301a >2013-12-09 03:41:00,158 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-37) No up server in cluster >2013-12-09 03:41:00,158 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-37) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:41:00,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a93f515 >2013-12-09 03:41:00,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterTasksListVDSCommand, return: [], log id: a93f515 >2013-12-09 03:41:02,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d73fec3 >2013-12-09 03:41:03,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2d73fec3 >2013-12-09 03:41:03,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73f5247a >2013-12-09 03:41:03,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73f5247a >2013-12-09 03:41:08,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f79109c >2013-12-09 03:41:08,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f79109c >2013-12-09 03:41:08,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3de4d226 >2013-12-09 03:41:09,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3de4d226 >2013-12-09 03:41:14,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43695179 >2013-12-09 03:41:14,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 43695179 >2013-12-09 03:41:14,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b79b058 >2013-12-09 03:41:15,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b79b058 >2013-12-09 03:41:20,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49876b11 >2013-12-09 03:41:20,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 49876b11 >2013-12-09 03:41:20,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e0595a0 >2013-12-09 03:41:20,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e0595a0 >2013-12-09 03:41:25,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e0bb39b >2013-12-09 03:41:26,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e0bb39b >2013-12-09 03:41:26,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70b4d299 >2013-12-09 03:41:26,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70b4d299 >2013-12-09 03:41:31,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 22b2d85d >2013-12-09 03:41:32,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 22b2d85d >2013-12-09 03:41:32,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 322f436f >2013-12-09 03:41:32,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 322f436f >2013-12-09 03:41:37,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6914cf3b >2013-12-09 03:41:37,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6914cf3b >2013-12-09 03:41:37,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b9771d4 >2013-12-09 03:41:38,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b9771d4 >2013-12-09 03:41:43,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3473bc40 >2013-12-09 03:41:43,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3473bc40 >2013-12-09 03:41:43,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c58d83b >2013-12-09 03:41:43,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c58d83b >2013-12-09 03:41:48,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e2373cc >2013-12-09 03:41:49,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2e2373cc >2013-12-09 03:41:49,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79357515 >2013-12-09 03:41:49,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79357515 >2013-12-09 03:41:54,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 446989a2 >2013-12-09 03:41:55,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 446989a2 >2013-12-09 03:41:55,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 739eb533 >2013-12-09 03:41:55,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 739eb533 >2013-12-09 03:42:00,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d4d90c4 >2013-12-09 03:42:00,436 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-66) No up server in cluster >2013-12-09 03:42:00,437 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-66) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:42:00,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a0964a1 >2013-12-09 03:42:00,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3a0964a1 >2013-12-09 03:42:00,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d4d90c4 >2013-12-09 03:42:00,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4eed549d >2013-12-09 03:42:01,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4eed549d >2013-12-09 03:42:06,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3cb54af2 >2013-12-09 03:42:06,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3cb54af2 >2013-12-09 03:42:06,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5179a8c9 >2013-12-09 03:42:06,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5179a8c9 >2013-12-09 03:42:11,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e896da9 >2013-12-09 03:42:12,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6e896da9 >2013-12-09 03:42:12,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ba20794 >2013-12-09 03:42:12,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ba20794 >2013-12-09 03:42:17,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60a1aebe >2013-12-09 03:42:18,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 60a1aebe >2013-12-09 03:42:18,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e071417 >2013-12-09 03:42:18,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e071417 >2013-12-09 03:42:23,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e1db347 >2013-12-09 03:42:24,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e1db347 >2013-12-09 03:42:24,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3be76515 >2013-12-09 03:42:24,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3be76515 >2013-12-09 03:42:29,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fababcd >2013-12-09 03:42:29,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7fababcd >2013-12-09 03:42:29,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66fb12a0 >2013-12-09 03:42:30,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66fb12a0 >2013-12-09 03:42:35,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e9e3612 >2013-12-09 03:42:35,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e9e3612 >2013-12-09 03:42:35,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a1ff497 >2013-12-09 03:42:35,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a1ff497 >2013-12-09 03:42:40,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7bc14a4c >2013-12-09 03:42:41,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7bc14a4c >2013-12-09 03:42:41,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68a0437e >2013-12-09 03:42:41,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68a0437e >2013-12-09 03:42:46,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30d17702 >2013-12-09 03:42:47,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 30d17702 >2013-12-09 03:42:47,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ff7b8e7 >2013-12-09 03:42:47,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ff7b8e7 >2013-12-09 03:42:52,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57526b88 >2013-12-09 03:42:52,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 57526b88 >2013-12-09 03:42:52,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a6e0e3e >2013-12-09 03:42:53,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a6e0e3e >2013-12-09 03:42:58,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d5a8ff7 >2013-12-09 03:42:58,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6d5a8ff7 >2013-12-09 03:42:58,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 193f9bf2 >2013-12-09 03:42:58,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 193f9bf2 >2013-12-09 03:43:00,694 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-64) No up server in cluster >2013-12-09 03:43:00,695 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-64) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:43:00,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d2dbaed >2013-12-09 03:43:00,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3d2dbaed >2013-12-09 03:43:03,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10ff1fc8 >2013-12-09 03:43:04,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 10ff1fc8 >2013-12-09 03:43:04,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6383236f >2013-12-09 03:43:04,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6383236f >2013-12-09 03:43:09,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 173d178e >2013-12-09 03:43:10,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 173d178e >2013-12-09 03:43:10,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 206ee0aa >2013-12-09 03:43:10,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 206ee0aa >2013-12-09 03:43:15,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c8e7f97 >2013-12-09 03:43:16,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2c8e7f97 >2013-12-09 03:43:16,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 383c4f1c >2013-12-09 03:43:16,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 383c4f1c >2013-12-09 03:43:21,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79e0c109 >2013-12-09 03:43:21,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 79e0c109 >2013-12-09 03:43:21,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 764d533b >2013-12-09 03:43:22,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 764d533b >2013-12-09 03:43:27,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d8d9211 >2013-12-09 03:43:27,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: d8d9211 >2013-12-09 03:43:27,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 506c2ec0 >2013-12-09 03:43:27,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 506c2ec0 >2013-12-09 03:43:32,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 108c291e >2013-12-09 03:43:33,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 108c291e >2013-12-09 03:43:33,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5130b2b0 >2013-12-09 03:43:33,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5130b2b0 >2013-12-09 03:43:38,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e8ae247 >2013-12-09 03:43:39,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e8ae247 >2013-12-09 03:43:39,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27acfba7 >2013-12-09 03:43:39,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27acfba7 >2013-12-09 03:43:44,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3822d3ab >2013-12-09 03:43:44,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3822d3ab >2013-12-09 03:43:44,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f6058f5 >2013-12-09 03:43:45,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f6058f5 >2013-12-09 03:43:50,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77df7a69 >2013-12-09 03:43:50,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 77df7a69 >2013-12-09 03:43:50,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bb432ef >2013-12-09 03:43:51,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4bb432ef >2013-12-09 03:43:56,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62f76c88 >2013-12-09 03:43:56,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 62f76c88 >2013-12-09 03:43:56,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65b855ba >2013-12-09 03:43:56,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65b855ba >2013-12-09 03:44:00,976 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-100) No up server in cluster >2013-12-09 03:44:00,977 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-100) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:44:00,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 235e51e0 >2013-12-09 03:44:01,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterTasksListVDSCommand, return: [], log id: 235e51e0 >2013-12-09 03:44:01,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c4e5261 >2013-12-09 03:44:02,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c4e5261 >2013-12-09 03:44:02,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34716110 >2013-12-09 03:44:02,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34716110 >2013-12-09 03:44:07,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4690f868 >2013-12-09 03:44:08,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4690f868 >2013-12-09 03:44:08,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46111a31 >2013-12-09 03:44:08,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46111a31 >2013-12-09 03:44:13,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12e5ab76 >2013-12-09 03:44:13,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 12e5ab76 >2013-12-09 03:44:13,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 90426cc >2013-12-09 03:44:14,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 90426cc >2013-12-09 03:44:19,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d99de51 >2013-12-09 03:44:19,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d99de51 >2013-12-09 03:44:19,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b391e43 >2013-12-09 03:44:19,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b391e43 >2013-12-09 03:44:24,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 659a8a9 >2013-12-09 03:44:25,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 659a8a9 >2013-12-09 03:44:25,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70cddcb8 >2013-12-09 03:44:25,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70cddcb8 >2013-12-09 03:44:30,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 593ed107 >2013-12-09 03:44:31,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 593ed107 >2013-12-09 03:44:31,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 500fbceb >2013-12-09 03:44:31,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 500fbceb >2013-12-09 03:44:36,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d32c6c5 >2013-12-09 03:44:37,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d32c6c5 >2013-12-09 03:44:37,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36de77c8 >2013-12-09 03:44:37,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36de77c8 >2013-12-09 03:44:42,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 49a39543 >2013-12-09 03:44:42,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 49a39543 >2013-12-09 03:44:42,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d4961fc >2013-12-09 03:44:43,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d4961fc >2013-12-09 03:44:48,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4aa453c3 >2013-12-09 03:44:48,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4aa453c3 >2013-12-09 03:44:48,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 117f057d >2013-12-09 03:44:48,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 117f057d >2013-12-09 03:44:53,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 769d96b9 >2013-12-09 03:44:54,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 769d96b9 >2013-12-09 03:44:54,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2415a16f >2013-12-09 03:44:54,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2415a16f >2013-12-09 03:44:59,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d25435b >2013-12-09 03:45:00,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d25435b >2013-12-09 03:45:00,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 328b7007 >2013-12-09 03:45:00,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 328b7007 >2013-12-09 03:45:01,267 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) No up server in cluster >2013-12-09 03:45:01,267 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:45:01,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78d7a858 >2013-12-09 03:45:01,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterTasksListVDSCommand, return: [], log id: 78d7a858 >2013-12-09 03:45:05,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1640a1d3 >2013-12-09 03:45:05,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1640a1d3 >2013-12-09 03:45:05,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70de0995 >2013-12-09 03:45:06,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70de0995 >2013-12-09 03:45:11,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 574f4a4d >2013-12-09 03:45:11,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 574f4a4d >2013-12-09 03:45:11,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35f224c3 >2013-12-09 03:45:12,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35f224c3 >2013-12-09 03:45:17,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e7bd374 >2013-12-09 03:45:17,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e7bd374 >2013-12-09 03:45:17,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 195a9827 >2013-12-09 03:45:17,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 195a9827 >2013-12-09 03:45:22,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d4fcd0f >2013-12-09 03:45:23,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: d4fcd0f >2013-12-09 03:45:23,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2391f5ed >2013-12-09 03:45:23,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2391f5ed >2013-12-09 03:45:28,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 167d319e >2013-12-09 03:45:29,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 167d319e >2013-12-09 03:45:29,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8ab99d0 >2013-12-09 03:45:29,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8ab99d0 >2013-12-09 03:45:34,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43d2df4f >2013-12-09 03:45:34,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 43d2df4f >2013-12-09 03:45:34,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38eb5ad4 >2013-12-09 03:45:35,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38eb5ad4 >2013-12-09 03:45:40,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 620621f7 >2013-12-09 03:45:40,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 620621f7 >2013-12-09 03:45:40,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33b6206 >2013-12-09 03:45:40,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33b6206 >2013-12-09 03:45:45,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4686e1af >2013-12-09 03:45:46,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4686e1af >2013-12-09 03:45:46,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12062a4 >2013-12-09 03:45:46,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12062a4 >2013-12-09 03:45:51,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61e760fc >2013-12-09 03:45:52,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 61e760fc >2013-12-09 03:45:52,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6034e4a7 >2013-12-09 03:45:52,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6034e4a7 >2013-12-09 03:45:57,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 673e6301 >2013-12-09 03:45:58,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 673e6301 >2013-12-09 03:45:58,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77910f1a >2013-12-09 03:45:58,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77910f1a >2013-12-09 03:46:01,541 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-91) No up server in cluster >2013-12-09 03:46:01,541 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-91) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:46:01,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 358161db >2013-12-09 03:46:01,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterTasksListVDSCommand, return: [], log id: 358161db >2013-12-09 03:46:03,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d71aebe >2013-12-09 03:46:03,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6d71aebe >2013-12-09 03:46:03,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 772c6283 >2013-12-09 03:46:04,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 772c6283 >2013-12-09 03:46:09,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 442b12c9 >2013-12-09 03:46:09,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 442b12c9 >2013-12-09 03:46:09,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 153cd143 >2013-12-09 03:46:09,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 153cd143 >2013-12-09 03:46:14,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2aff8d97 >2013-12-09 03:46:15,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2aff8d97 >2013-12-09 03:46:15,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b00a0ec >2013-12-09 03:46:15,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b00a0ec >2013-12-09 03:46:20,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 482d32f >2013-12-09 03:46:21,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 482d32f >2013-12-09 03:46:21,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: df9a93e >2013-12-09 03:46:21,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: df9a93e >2013-12-09 03:46:26,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26e3fa44 >2013-12-09 03:46:26,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 26e3fa44 >2013-12-09 03:46:26,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f4ab7b6 >2013-12-09 03:46:27,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f4ab7b6 >2013-12-09 03:46:32,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61516a00 >2013-12-09 03:46:32,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 61516a00 >2013-12-09 03:46:32,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e1b4621 >2013-12-09 03:46:33,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e1b4621 >2013-12-09 03:46:38,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17757c31 >2013-12-09 03:46:38,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 17757c31 >2013-12-09 03:46:38,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1246b667 >2013-12-09 03:46:38,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1246b667 >2013-12-09 03:46:43,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57936e4d >2013-12-09 03:46:44,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 57936e4d >2013-12-09 03:46:44,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40fc7230 >2013-12-09 03:46:44,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40fc7230 >2013-12-09 03:46:49,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 174de180 >2013-12-09 03:46:50,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 174de180 >2013-12-09 03:46:50,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45bb17b6 >2013-12-09 03:46:50,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45bb17b6 >2013-12-09 03:46:55,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10bdbd23 >2013-12-09 03:46:55,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 10bdbd23 >2013-12-09 03:46:55,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d91f45e >2013-12-09 03:46:56,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d91f45e >2013-12-09 03:47:01,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50816958 >2013-12-09 03:47:01,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 50816958 >2013-12-09 03:47:01,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6397f988 >2013-12-09 03:47:01,823 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-45) No up server in cluster >2013-12-09 03:47:01,823 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-45) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:47:01,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6fd24bde >2013-12-09 03:47:01,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6397f988 >2013-12-09 03:47:02,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6fd24bde >2013-12-09 03:47:06,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 305ee4de >2013-12-09 03:47:07,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 305ee4de >2013-12-09 03:47:07,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b5f2ce2 >2013-12-09 03:47:07,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b5f2ce2 >2013-12-09 03:47:12,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ee39e34 >2013-12-09 03:47:13,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3ee39e34 >2013-12-09 03:47:13,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37581e00 >2013-12-09 03:47:13,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37581e00 >2013-12-09 03:47:18,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65343329 >2013-12-09 03:47:18,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 65343329 >2013-12-09 03:47:18,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 755c3d2d >2013-12-09 03:47:19,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 755c3d2d >2013-12-09 03:47:24,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b8754e >2013-12-09 03:47:24,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b8754e >2013-12-09 03:47:24,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a1520c >2013-12-09 03:47:25,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a1520c >2013-12-09 03:47:30,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 321ed2c8 >2013-12-09 03:47:30,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 321ed2c8 >2013-12-09 03:47:30,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d89674b >2013-12-09 03:47:30,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d89674b >2013-12-09 03:47:35,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 749ca6a2 >2013-12-09 03:47:36,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 749ca6a2 >2013-12-09 03:47:36,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fb646 >2013-12-09 03:47:36,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fb646 >2013-12-09 03:47:41,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 740cdc97 >2013-12-09 03:47:42,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 740cdc97 >2013-12-09 03:47:42,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9855ee1 >2013-12-09 03:47:42,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9855ee1 >2013-12-09 03:47:47,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4cbe27c5 >2013-12-09 03:47:47,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4cbe27c5 >2013-12-09 03:47:47,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62c02971 >2013-12-09 03:47:48,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62c02971 >2013-12-09 03:47:53,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 136388a >2013-12-09 03:47:53,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 136388a >2013-12-09 03:47:53,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28c467dc >2013-12-09 03:47:53,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28c467dc >2013-12-09 03:47:58,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65801a00 >2013-12-09 03:47:59,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 65801a00 >2013-12-09 03:47:59,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 453896a2 >2013-12-09 03:47:59,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 453896a2 >2013-12-09 03:48:02,098 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-4) No up server in cluster >2013-12-09 03:48:02,098 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-4) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:48:02,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2dd9038a >2013-12-09 03:48:02,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2dd9038a >2013-12-09 03:48:04,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60566785 >2013-12-09 03:48:05,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 60566785 >2013-12-09 03:48:05,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 44267168 >2013-12-09 03:48:05,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44267168 >2013-12-09 03:48:10,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4623580 >2013-12-09 03:48:11,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4623580 >2013-12-09 03:48:11,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1dccd22b >2013-12-09 03:48:11,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1dccd22b >2013-12-09 03:48:16,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f33b5ba >2013-12-09 03:48:16,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1f33b5ba >2013-12-09 03:48:16,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c3df249 >2013-12-09 03:48:17,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c3df249 >2013-12-09 03:48:22,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51d3240f >2013-12-09 03:48:22,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 51d3240f >2013-12-09 03:48:22,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4829394f >2013-12-09 03:48:22,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4829394f >2013-12-09 03:48:27,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d642608 >2013-12-09 03:48:28,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4d642608 >2013-12-09 03:48:28,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 352dd6ae >2013-12-09 03:48:28,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 352dd6ae >2013-12-09 03:48:33,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57cd4d67 >2013-12-09 03:48:33,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 57cd4d67 >2013-12-09 03:48:33,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1186e51 >2013-12-09 03:48:34,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1186e51 >2013-12-09 03:48:39,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a99432 >2013-12-09 03:48:39,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7a99432 >2013-12-09 03:48:39,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6130da28 >2013-12-09 03:48:39,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6130da28 >2013-12-09 03:48:44,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69df8e8 >2013-12-09 03:48:45,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 69df8e8 >2013-12-09 03:48:45,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4836d5cf >2013-12-09 03:48:45,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4836d5cf >2013-12-09 03:48:50,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73918f89 >2013-12-09 03:48:51,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 73918f89 >2013-12-09 03:48:51,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17cfba09 >2013-12-09 03:48:51,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17cfba09 >2013-12-09 03:48:56,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20cb7860 >2013-12-09 03:48:57,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 20cb7860 >2013-12-09 03:48:57,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53dcecc5 >2013-12-09 03:48:57,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53dcecc5 >2013-12-09 03:49:02,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 693a9373 >2013-12-09 03:49:02,383 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-19) No up server in cluster >2013-12-09 03:49:02,383 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-19) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:49:02,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 309ebece >2013-12-09 03:49:02,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterTasksListVDSCommand, return: [], log id: 309ebece >2013-12-09 03:49:02,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 693a9373 >2013-12-09 03:49:02,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ee66b71 >2013-12-09 03:49:03,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ee66b71 >2013-12-09 03:49:08,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ebd88ce >2013-12-09 03:49:08,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6ebd88ce >2013-12-09 03:49:08,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67d84492 >2013-12-09 03:49:08,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67d84492 >2013-12-09 03:49:13,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41abf80d >2013-12-09 03:49:14,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 41abf80d >2013-12-09 03:49:14,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fa02658 >2013-12-09 03:49:14,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fa02658 >2013-12-09 03:49:19,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42725495 >2013-12-09 03:49:20,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42725495 >2013-12-09 03:49:20,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7645342b >2013-12-09 03:49:20,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7645342b >2013-12-09 03:49:25,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 599bc96d >2013-12-09 03:49:25,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 599bc96d >2013-12-09 03:49:25,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b96f1a9 >2013-12-09 03:49:26,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b96f1a9 >2013-12-09 03:49:31,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50b8a42b >2013-12-09 03:49:31,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 50b8a42b >2013-12-09 03:49:31,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e1924d8 >2013-12-09 03:49:31,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e1924d8 >2013-12-09 03:49:36,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 366dde33 >2013-12-09 03:49:37,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 366dde33 >2013-12-09 03:49:37,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57108483 >2013-12-09 03:49:37,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57108483 >2013-12-09 03:49:42,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 724231a3 >2013-12-09 03:49:43,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 724231a3 >2013-12-09 03:49:43,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62e76cd3 >2013-12-09 03:49:43,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62e76cd3 >2013-12-09 03:49:48,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f322cb4 >2013-12-09 03:49:49,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7f322cb4 >2013-12-09 03:49:49,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50fde443 >2013-12-09 03:49:49,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50fde443 >2013-12-09 03:49:54,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26228e2f >2013-12-09 03:49:54,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 26228e2f >2013-12-09 03:49:54,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 250fbcfb >2013-12-09 03:49:55,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 250fbcfb >2013-12-09 03:50:00,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ef1477b >2013-12-09 03:50:00,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ef1477b >2013-12-09 03:50:00,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b29a350 >2013-12-09 03:50:00,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b29a350 >2013-12-09 03:50:02,656 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-32) No up server in cluster >2013-12-09 03:50:02,656 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-32) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:50:02,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2982c7d1 >2013-12-09 03:50:02,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2982c7d1 >2013-12-09 03:50:05,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4fc67b91 >2013-12-09 03:50:06,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4fc67b91 >2013-12-09 03:50:06,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35e55b79 >2013-12-09 03:50:06,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35e55b79 >2013-12-09 03:50:11,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15b9cd29 >2013-12-09 03:50:12,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 15b9cd29 >2013-12-09 03:50:12,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39e2a320 >2013-12-09 03:50:12,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39e2a320 >2013-12-09 03:50:17,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 289b7584 >2013-12-09 03:50:17,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 289b7584 >2013-12-09 03:50:17,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16cb5d53 >2013-12-09 03:50:18,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16cb5d53 >2013-12-09 03:50:23,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fb438c7 >2013-12-09 03:50:23,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7fb438c7 >2013-12-09 03:50:23,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72f6254b >2013-12-09 03:50:23,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72f6254b >2013-12-09 03:50:28,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: fb5aa65 >2013-12-09 03:50:29,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: fb5aa65 >2013-12-09 03:50:29,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35a465f1 >2013-12-09 03:50:29,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35a465f1 >2013-12-09 03:50:34,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ba6f7bf >2013-12-09 03:50:35,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ba6f7bf >2013-12-09 03:50:35,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2329ab3f >2013-12-09 03:50:35,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2329ab3f >2013-12-09 03:50:40,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ba8f487 >2013-12-09 03:50:41,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7ba8f487 >2013-12-09 03:50:41,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30b53092 >2013-12-09 03:50:41,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30b53092 >2013-12-09 03:50:46,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39b5e967 >2013-12-09 03:50:46,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 39b5e967 >2013-12-09 03:50:46,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5049e1fc >2013-12-09 03:50:47,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5049e1fc >2013-12-09 03:50:52,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d21af1f >2013-12-09 03:50:52,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d21af1f >2013-12-09 03:50:52,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ad24ee2 >2013-12-09 03:50:52,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ad24ee2 >2013-12-09 03:50:57,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1aa9cd17 >2013-12-09 03:50:58,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1aa9cd17 >2013-12-09 03:50:58,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58ef130a >2013-12-09 03:50:58,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58ef130a >2013-12-09 03:51:02,935 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-56) No up server in cluster >2013-12-09 03:51:02,935 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-56) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:51:02,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f585115 >2013-12-09 03:51:03,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterTasksListVDSCommand, return: [], log id: f585115 >2013-12-09 03:51:03,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f8f887f >2013-12-09 03:51:04,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f8f887f >2013-12-09 03:51:04,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 767410a7 >2013-12-09 03:51:04,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 767410a7 >2013-12-09 03:51:09,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bb6247e >2013-12-09 03:51:09,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2bb6247e >2013-12-09 03:51:09,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 450b2887 >2013-12-09 03:51:10,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 450b2887 >2013-12-09 03:51:15,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a46cb34 >2013-12-09 03:51:15,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7a46cb34 >2013-12-09 03:51:15,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 134babe9 >2013-12-09 03:51:15,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 134babe9 >2013-12-09 03:51:20,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64aae671 >2013-12-09 03:51:21,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 64aae671 >2013-12-09 03:51:21,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6709805f >2013-12-09 03:51:21,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6709805f >2013-12-09 03:51:26,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a822247 >2013-12-09 03:51:27,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a822247 >2013-12-09 03:51:27,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a9450e1 >2013-12-09 03:51:27,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a9450e1 >2013-12-09 03:51:32,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6339e3a2 >2013-12-09 03:51:32,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6339e3a2 >2013-12-09 03:51:32,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e7ef6dc >2013-12-09 03:51:33,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e7ef6dc >2013-12-09 03:51:38,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 344dbf50 >2013-12-09 03:51:38,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 344dbf50 >2013-12-09 03:51:38,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d7eaa3f >2013-12-09 03:51:38,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d7eaa3f >2013-12-09 03:51:44,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 482528f7 >2013-12-09 03:51:44,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 482528f7 >2013-12-09 03:51:44,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f120920 >2013-12-09 03:51:44,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f120920 >2013-12-09 03:51:49,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e3b25c2 >2013-12-09 03:51:50,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e3b25c2 >2013-12-09 03:51:50,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7abd1f67 >2013-12-09 03:51:50,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7abd1f67 >2013-12-09 03:51:55,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 98917f4 >2013-12-09 03:51:56,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 98917f4 >2013-12-09 03:51:56,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4fd5b0a1 >2013-12-09 03:51:56,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fd5b0a1 >2013-12-09 03:52:01,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1fc34660 >2013-12-09 03:52:01,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1fc34660 >2013-12-09 03:52:01,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e05e990 >2013-12-09 03:52:02,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e05e990 >2013-12-09 03:52:03,218 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-26) No up server in cluster >2013-12-09 03:52:03,218 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-26) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:52:03,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b69342d >2013-12-09 03:52:03,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3b69342d >2013-12-09 03:52:07,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e2d1f0c >2013-12-09 03:52:07,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1e2d1f0c >2013-12-09 03:52:07,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 96efd9e >2013-12-09 03:52:07,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 96efd9e >2013-12-09 03:52:12,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 741a5e7d >2013-12-09 03:52:13,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 741a5e7d >2013-12-09 03:52:13,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6501a921 >2013-12-09 03:52:13,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6501a921 >2013-12-09 03:52:18,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c98b654 >2013-12-09 03:52:19,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2c98b654 >2013-12-09 03:52:19,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7243cad9 >2013-12-09 03:52:19,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7243cad9 >2013-12-09 03:52:24,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 706bd057 >2013-12-09 03:52:24,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 706bd057 >2013-12-09 03:52:24,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f2dd4fb >2013-12-09 03:52:25,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f2dd4fb >2013-12-09 03:52:30,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46cc09d >2013-12-09 03:52:30,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 46cc09d >2013-12-09 03:52:30,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b6f29c7 >2013-12-09 03:52:31,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b6f29c7 >2013-12-09 03:52:36,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b7fb82e >2013-12-09 03:52:36,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b7fb82e >2013-12-09 03:52:36,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c6b982b >2013-12-09 03:52:36,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c6b982b >2013-12-09 03:52:41,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32851418 >2013-12-09 03:52:42,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 32851418 >2013-12-09 03:52:42,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7cefe01a >2013-12-09 03:52:42,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7cefe01a >2013-12-09 03:52:47,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b78114a >2013-12-09 03:52:48,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b78114a >2013-12-09 03:52:48,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5354afb4 >2013-12-09 03:52:48,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5354afb4 >2013-12-09 03:52:53,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3db2b3d1 >2013-12-09 03:52:53,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3db2b3d1 >2013-12-09 03:52:53,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e90e1fc >2013-12-09 03:52:54,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e90e1fc >2013-12-09 03:52:59,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 204cc7a >2013-12-09 03:52:59,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 204cc7a >2013-12-09 03:52:59,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b47fd1 >2013-12-09 03:52:59,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b47fd1 >2013-12-09 03:53:03,510 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-76) No up server in cluster >2013-12-09 03:53:03,510 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-76) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:53:03,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56773b9f >2013-12-09 03:53:03,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterTasksListVDSCommand, return: [], log id: 56773b9f >2013-12-09 03:53:04,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78dfedfc >2013-12-09 03:53:05,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 78dfedfc >2013-12-09 03:53:05,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1873bdc1 >2013-12-09 03:53:05,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1873bdc1 >2013-12-09 03:53:10,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43e63cad >2013-12-09 03:53:11,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 43e63cad >2013-12-09 03:53:11,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e12247 >2013-12-09 03:53:11,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e12247 >2013-12-09 03:53:16,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12514b8d >2013-12-09 03:53:16,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 12514b8d >2013-12-09 03:53:16,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a14fa6c >2013-12-09 03:53:17,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a14fa6c >2013-12-09 03:53:22,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e25e2f3 >2013-12-09 03:53:22,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: e25e2f3 >2013-12-09 03:53:22,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20505a40 >2013-12-09 03:53:23,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20505a40 >2013-12-09 03:53:28,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67313ce2 >2013-12-09 03:53:28,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 67313ce2 >2013-12-09 03:53:28,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 380cb401 >2013-12-09 03:53:28,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 380cb401 >2013-12-09 03:53:33,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 332e2507 >2013-12-09 03:53:34,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 332e2507 >2013-12-09 03:53:34,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46c7ba5f >2013-12-09 03:53:34,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46c7ba5f >2013-12-09 03:53:39,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 281a5507 >2013-12-09 03:53:40,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 281a5507 >2013-12-09 03:53:40,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58378d3d >2013-12-09 03:53:40,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58378d3d >2013-12-09 03:53:45,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 249d56d6 >2013-12-09 03:53:45,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 249d56d6 >2013-12-09 03:53:45,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35ffa7eb >2013-12-09 03:53:46,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35ffa7eb >2013-12-09 03:53:51,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a9c0c65 >2013-12-09 03:53:51,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a9c0c65 >2013-12-09 03:53:51,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 487afd6c >2013-12-09 03:53:51,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 487afd6c >2013-12-09 03:53:56,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5476d7ec >2013-12-09 03:53:57,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5476d7ec >2013-12-09 03:53:57,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b188275 >2013-12-09 03:53:57,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b188275 >2013-12-09 03:54:02,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e80a73d >2013-12-09 03:54:03,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e80a73d >2013-12-09 03:54:03,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45b7f4d7 >2013-12-09 03:54:03,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45b7f4d7 >2013-12-09 03:54:03,784 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-88) No up server in cluster >2013-12-09 03:54:03,784 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-88) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:54:03,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72695439 >2013-12-09 03:54:04,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterTasksListVDSCommand, return: [], log id: 72695439 >2013-12-09 03:54:08,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 612bf4dc >2013-12-09 03:54:09,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 612bf4dc >2013-12-09 03:54:09,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17ec6f1b >2013-12-09 03:54:09,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17ec6f1b >2013-12-09 03:54:14,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13222b40 >2013-12-09 03:54:14,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 13222b40 >2013-12-09 03:54:14,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7967c339 >2013-12-09 03:54:15,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7967c339 >2013-12-09 03:54:20,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2224aa7c >2013-12-09 03:54:20,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2224aa7c >2013-12-09 03:54:20,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4efe8268 >2013-12-09 03:54:20,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4efe8268 >2013-12-09 03:54:25,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d0ad487 >2013-12-09 03:54:26,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6d0ad487 >2013-12-09 03:54:26,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4058387b >2013-12-09 03:54:26,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4058387b >2013-12-09 03:54:31,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a3af210 >2013-12-09 03:54:32,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3a3af210 >2013-12-09 03:54:32,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 28307956 >2013-12-09 03:54:32,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28307956 >2013-12-09 03:54:37,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f8acf7f >2013-12-09 03:54:37,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f8acf7f >2013-12-09 03:54:37,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58b35ea1 >2013-12-09 03:54:38,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58b35ea1 >2013-12-09 03:54:43,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77a822a >2013-12-09 03:54:43,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 77a822a >2013-12-09 03:54:43,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 679f06da >2013-12-09 03:54:43,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 679f06da >2013-12-09 03:54:49,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 547aaeb7 >2013-12-09 03:54:49,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 547aaeb7 >2013-12-09 03:54:49,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20d3b780 >2013-12-09 03:54:49,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20d3b780 >2013-12-09 03:54:54,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36e396ac >2013-12-09 03:54:55,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 36e396ac >2013-12-09 03:54:55,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e4ced41 >2013-12-09 03:54:55,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e4ced41 >2013-12-09 03:55:00,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e0a2ed6 >2013-12-09 03:55:01,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e0a2ed6 >2013-12-09 03:55:01,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23bde6a8 >2013-12-09 03:55:01,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23bde6a8 >2013-12-09 03:55:04,048 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-34) No up server in cluster >2013-12-09 03:55:04,049 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-34) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:55:04,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5cb27113 >2013-12-09 03:55:04,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5cb27113 >2013-12-09 03:55:06,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 92a1c1a >2013-12-09 03:55:06,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 92a1c1a >2013-12-09 03:55:06,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 953c035 >2013-12-09 03:55:07,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 953c035 >2013-12-09 03:55:12,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43b73851 >2013-12-09 03:55:12,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 43b73851 >2013-12-09 03:55:12,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 352c4fbf >2013-12-09 03:55:12,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 352c4fbf >2013-12-09 03:55:17,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f2de958 >2013-12-09 03:55:18,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f2de958 >2013-12-09 03:55:18,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23e16ba8 >2013-12-09 03:55:18,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23e16ba8 >2013-12-09 03:55:23,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7769b8d9 >2013-12-09 03:55:24,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7769b8d9 >2013-12-09 03:55:24,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c8215ac >2013-12-09 03:55:24,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c8215ac >2013-12-09 03:55:29,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19b315f4 >2013-12-09 03:55:29,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19b315f4 >2013-12-09 03:55:29,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a7fccbe >2013-12-09 03:55:30,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a7fccbe >2013-12-09 03:55:35,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59bc1f28 >2013-12-09 03:55:35,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59bc1f28 >2013-12-09 03:55:35,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 792ae35c >2013-12-09 03:55:36,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 792ae35c >2013-12-09 03:55:41,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5946a48e >2013-12-09 03:55:41,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5946a48e >2013-12-09 03:55:41,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 353bc935 >2013-12-09 03:55:41,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 353bc935 >2013-12-09 03:55:46,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 296bc413 >2013-12-09 03:55:47,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 296bc413 >2013-12-09 03:55:47,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 760aed10 >2013-12-09 03:55:47,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 760aed10 >2013-12-09 03:55:52,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 22c21d10 >2013-12-09 03:55:53,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 22c21d10 >2013-12-09 03:55:53,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b93feb5 >2013-12-09 03:55:53,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b93feb5 >2013-12-09 03:55:58,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21424eff >2013-12-09 03:55:58,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 21424eff >2013-12-09 03:55:58,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e1739de >2013-12-09 03:55:59,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e1739de >2013-12-09 03:56:04,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53800f7a >2013-12-09 03:56:04,337 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-94) No up server in cluster >2013-12-09 03:56:04,337 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-94) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:56:04,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13d3ceae >2013-12-09 03:56:04,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterTasksListVDSCommand, return: [], log id: 13d3ceae >2013-12-09 03:56:04,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 53800f7a >2013-12-09 03:56:04,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e0d1513 >2013-12-09 03:56:04,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e0d1513 >2013-12-09 03:56:09,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23c07590 >2013-12-09 03:56:10,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 23c07590 >2013-12-09 03:56:10,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24645966 >2013-12-09 03:56:10,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24645966 >2013-12-09 03:56:15,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26528059 >2013-12-09 03:56:16,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 26528059 >2013-12-09 03:56:16,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ca7cd16 >2013-12-09 03:56:16,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ca7cd16 >2013-12-09 03:56:21,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38c3b3e >2013-12-09 03:56:21,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 38c3b3e >2013-12-09 03:56:21,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18277c96 >2013-12-09 03:56:22,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18277c96 >2013-12-09 03:56:27,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3cddc676 >2013-12-09 03:56:27,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3cddc676 >2013-12-09 03:56:27,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 213e53e8 >2013-12-09 03:56:28,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 213e53e8 >2013-12-09 03:56:33,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ea52c75 >2013-12-09 03:56:33,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7ea52c75 >2013-12-09 03:56:33,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2055643d >2013-12-09 03:56:33,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2055643d >2013-12-09 03:56:38,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c96d6cc >2013-12-09 03:56:39,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c96d6cc >2013-12-09 03:56:39,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58e92bf7 >2013-12-09 03:56:39,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58e92bf7 >2013-12-09 03:56:44,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5fa472c2 >2013-12-09 03:56:45,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5fa472c2 >2013-12-09 03:56:45,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 84cb9f0 >2013-12-09 03:56:45,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 84cb9f0 >2013-12-09 03:56:50,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62f5d59f >2013-12-09 03:56:50,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 62f5d59f >2013-12-09 03:56:50,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3aa317ba >2013-12-09 03:56:51,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3aa317ba >2013-12-09 03:56:56,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77c5cbc0 >2013-12-09 03:56:56,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 77c5cbc0 >2013-12-09 03:56:56,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54a0a5a0 >2013-12-09 03:56:56,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54a0a5a0 >2013-12-09 03:57:01,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4781028d >2013-12-09 03:57:02,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4781028d >2013-12-09 03:57:02,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7601887a >2013-12-09 03:57:02,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7601887a >2013-12-09 03:57:04,598 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-6) No up server in cluster >2013-12-09 03:57:04,598 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-6) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:57:04,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a762777 >2013-12-09 03:57:04,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4a762777 >2013-12-09 03:57:07,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57ef8e63 >2013-12-09 03:57:08,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 57ef8e63 >2013-12-09 03:57:08,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55c23c38 >2013-12-09 03:57:08,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55c23c38 >2013-12-09 03:57:13,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 257a73fa >2013-12-09 03:57:14,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 257a73fa >2013-12-09 03:57:14,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6015a929 >2013-12-09 03:57:14,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6015a929 >2013-12-09 03:57:19,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50add24c >2013-12-09 03:57:19,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 50add24c >2013-12-09 03:57:19,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61e4d718 >2013-12-09 03:57:20,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61e4d718 >2013-12-09 03:57:25,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65400205 >2013-12-09 03:57:25,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 65400205 >2013-12-09 03:57:25,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: dbbfcc4 >2013-12-09 03:57:25,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: dbbfcc4 >2013-12-09 03:57:30,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79a518dc >2013-12-09 03:57:31,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 79a518dc >2013-12-09 03:57:31,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 317caa04 >2013-12-09 03:57:31,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 317caa04 >2013-12-09 03:57:36,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20f47ccf >2013-12-09 03:57:37,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 20f47ccf >2013-12-09 03:57:37,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6aa169a8 >2013-12-09 03:57:37,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6aa169a8 >2013-12-09 03:57:42,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66c9a01 >2013-12-09 03:57:42,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 66c9a01 >2013-12-09 03:57:42,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46b788d6 >2013-12-09 03:57:43,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46b788d6 >2013-12-09 03:57:48,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75062c91 >2013-12-09 03:57:48,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 75062c91 >2013-12-09 03:57:48,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2cd35ce4 >2013-12-09 03:57:48,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2cd35ce4 >2013-12-09 03:57:53,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13fd812 >2013-12-09 03:57:54,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 13fd812 >2013-12-09 03:57:54,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a473a22 >2013-12-09 03:57:54,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a473a22 >2013-12-09 03:57:59,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: edde450 >2013-12-09 03:58:00,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: edde450 >2013-12-09 03:58:00,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 770db472 >2013-12-09 03:58:00,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 770db472 >2013-12-09 03:58:04,898 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-14) No up server in cluster >2013-12-09 03:58:04,898 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-14) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:58:04,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 537e79de >2013-12-09 03:58:05,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterTasksListVDSCommand, return: [], log id: 537e79de >2013-12-09 03:58:05,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6665c9e7 >2013-12-09 03:58:06,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6665c9e7 >2013-12-09 03:58:06,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7bde6852 >2013-12-09 03:58:06,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7bde6852 >2013-12-09 03:58:11,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f0b4b60 >2013-12-09 03:58:11,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f0b4b60 >2013-12-09 03:58:11,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a177377 >2013-12-09 03:58:12,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a177377 >2013-12-09 03:58:17,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5fde701e >2013-12-09 03:58:17,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5fde701e >2013-12-09 03:58:17,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e7bd57a >2013-12-09 03:58:17,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e7bd57a >2013-12-09 03:58:22,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 581724c4 >2013-12-09 03:58:23,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 581724c4 >2013-12-09 03:58:23,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 576f83bf >2013-12-09 03:58:23,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 576f83bf >2013-12-09 03:58:28,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6df2bd62 >2013-12-09 03:58:29,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6df2bd62 >2013-12-09 03:58:29,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29731e1e >2013-12-09 03:58:29,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29731e1e >2013-12-09 03:58:34,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 541f6076 >2013-12-09 03:58:34,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 541f6076 >2013-12-09 03:58:34,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 683484b4 >2013-12-09 03:58:35,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 683484b4 >2013-12-09 03:58:40,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f0e34cd >2013-12-09 03:58:40,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f0e34cd >2013-12-09 03:58:40,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55192d4 >2013-12-09 03:58:40,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55192d4 >2013-12-09 03:58:46,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d13e417 >2013-12-09 03:58:46,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d13e417 >2013-12-09 03:58:46,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 375eb882 >2013-12-09 03:58:46,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 375eb882 >2013-12-09 03:58:51,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b5d50d4 >2013-12-09 03:58:52,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: b5d50d4 >2013-12-09 03:58:52,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ec3f0da >2013-12-09 03:58:52,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ec3f0da >2013-12-09 03:58:57,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f8582d9 >2013-12-09 03:58:58,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f8582d9 >2013-12-09 03:58:58,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a694644 >2013-12-09 03:58:58,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a694644 >2013-12-09 03:59:03,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4eb7c0f0 >2013-12-09 03:59:03,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4eb7c0f0 >2013-12-09 03:59:03,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30a7cbf1 >2013-12-09 03:59:04,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30a7cbf1 >2013-12-09 03:59:05,177 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-79) No up server in cluster >2013-12-09 03:59:05,178 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-79) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 03:59:05,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ca78bb3 >2013-12-09 03:59:05,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4ca78bb3 >2013-12-09 03:59:09,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13ed0f64 >2013-12-09 03:59:09,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 13ed0f64 >2013-12-09 03:59:09,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d3b1dca >2013-12-09 03:59:09,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d3b1dca >2013-12-09 03:59:14,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3cca3c39 >2013-12-09 03:59:15,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3cca3c39 >2013-12-09 03:59:15,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e1aea4a >2013-12-09 03:59:15,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e1aea4a >2013-12-09 03:59:20,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ca8998 >2013-12-09 03:59:21,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ca8998 >2013-12-09 03:59:21,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 352f122a >2013-12-09 03:59:21,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 352f122a >2013-12-09 03:59:26,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2da5336 >2013-12-09 03:59:26,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2da5336 >2013-12-09 03:59:26,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 303a806d >2013-12-09 03:59:27,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 303a806d >2013-12-09 03:59:32,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 752c1a89 >2013-12-09 03:59:32,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 752c1a89 >2013-12-09 03:59:32,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a63bb19 >2013-12-09 03:59:32,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a63bb19 >2013-12-09 03:59:37,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c1ed17b >2013-12-09 03:59:38,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c1ed17b >2013-12-09 03:59:38,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7309ff85 >2013-12-09 03:59:38,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7309ff85 >2013-12-09 03:59:38,725 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-42) Attempting to update VMs/Templates Ovf. >2013-12-09 03:59:43,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7fad40ff >2013-12-09 03:59:44,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7fad40ff >2013-12-09 03:59:44,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75c6ea07 >2013-12-09 03:59:44,262 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-54) Start refreshing all users data >2013-12-09 03:59:44,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75c6ea07 >2013-12-09 03:59:49,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66abc4c7 >2013-12-09 03:59:49,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 66abc4c7 >2013-12-09 03:59:49,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ee8ecb5 >2013-12-09 03:59:50,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ee8ecb5 >2013-12-09 03:59:55,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23f839de >2013-12-09 03:59:55,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 23f839de >2013-12-09 03:59:55,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1867bcd2 >2013-12-09 03:59:56,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1867bcd2 >2013-12-09 04:00:01,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7aa61250 >2013-12-09 04:00:01,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7aa61250 >2013-12-09 04:00:01,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a204ffd >2013-12-09 04:00:01,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a204ffd >2013-12-09 04:00:05,456 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-64) No up server in cluster >2013-12-09 04:00:05,456 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-64) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:00:05,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e00af85 >2013-12-09 04:00:05,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3e00af85 >2013-12-09 04:00:06,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d06409f >2013-12-09 04:00:07,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6d06409f >2013-12-09 04:00:07,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a51f8cf >2013-12-09 04:00:07,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a51f8cf >2013-12-09 04:00:12,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f3d6cbe >2013-12-09 04:00:13,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f3d6cbe >2013-12-09 04:00:13,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3200d112 >2013-12-09 04:00:13,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3200d112 >2013-12-09 04:00:18,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34843e64 >2013-12-09 04:00:18,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 34843e64 >2013-12-09 04:00:18,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e69149 >2013-12-09 04:00:19,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e69149 >2013-12-09 04:00:24,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5cd6c7dd >2013-12-09 04:00:24,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5cd6c7dd >2013-12-09 04:00:24,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63143597 >2013-12-09 04:00:24,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63143597 >2013-12-09 04:00:29,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 571029e5 >2013-12-09 04:00:30,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 571029e5 >2013-12-09 04:00:30,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f5acfa6 >2013-12-09 04:00:30,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f5acfa6 >2013-12-09 04:00:35,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55f1e6b7 >2013-12-09 04:00:36,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 55f1e6b7 >2013-12-09 04:00:36,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c41378 >2013-12-09 04:00:36,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c41378 >2013-12-09 04:00:41,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a350b4d >2013-12-09 04:00:41,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a350b4d >2013-12-09 04:00:41,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6693f085 >2013-12-09 04:00:42,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6693f085 >2013-12-09 04:00:47,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7165bf7d >2013-12-09 04:00:47,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7165bf7d >2013-12-09 04:00:47,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e2ff2b4 >2013-12-09 04:00:47,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e2ff2b4 >2013-12-09 04:00:53,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fd6f6f0 >2013-12-09 04:00:53,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7fd6f6f0 >2013-12-09 04:00:53,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8c1af7c >2013-12-09 04:00:53,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8c1af7c >2013-12-09 04:00:58,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e21248c >2013-12-09 04:00:59,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4e21248c >2013-12-09 04:00:59,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e7a163b >2013-12-09 04:00:59,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e7a163b >2013-12-09 04:01:04,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 137e4de6 >2013-12-09 04:01:05,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 137e4de6 >2013-12-09 04:01:05,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 24857aba >2013-12-09 04:01:05,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24857aba >2013-12-09 04:01:05,749 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-50) No up server in cluster >2013-12-09 04:01:05,750 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-50) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:01:05,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f8b490a >2013-12-09 04:01:06,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1f8b490a >2013-12-09 04:01:10,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 670f7dd0 >2013-12-09 04:01:10,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 670f7dd0 >2013-12-09 04:01:10,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67348dd7 >2013-12-09 04:01:11,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67348dd7 >2013-12-09 04:01:16,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f3b211e >2013-12-09 04:01:16,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f3b211e >2013-12-09 04:01:16,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 559f6cb2 >2013-12-09 04:01:16,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 559f6cb2 >2013-12-09 04:01:21,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 103ffc99 >2013-12-09 04:01:22,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 103ffc99 >2013-12-09 04:01:22,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6365ad62 >2013-12-09 04:01:22,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6365ad62 >2013-12-09 04:01:27,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f717770 >2013-12-09 04:01:28,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f717770 >2013-12-09 04:01:28,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b16f4b3 >2013-12-09 04:01:28,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b16f4b3 >2013-12-09 04:01:33,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f1c793f >2013-12-09 04:01:34,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5f1c793f >2013-12-09 04:01:34,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75047954 >2013-12-09 04:01:34,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75047954 >2013-12-09 04:01:39,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11d21013 >2013-12-09 04:01:39,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 11d21013 >2013-12-09 04:01:39,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56434266 >2013-12-09 04:01:40,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56434266 >2013-12-09 04:01:45,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 458dcbab >2013-12-09 04:01:45,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 458dcbab >2013-12-09 04:01:45,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3faf123b >2013-12-09 04:01:45,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3faf123b >2013-12-09 04:01:50,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c5a2430 >2013-12-09 04:01:51,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c5a2430 >2013-12-09 04:01:51,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 161fdc1f >2013-12-09 04:01:51,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 161fdc1f >2013-12-09 04:01:56,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c9d6c18 >2013-12-09 04:01:57,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c9d6c18 >2013-12-09 04:01:57,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ec73dcd >2013-12-09 04:01:57,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ec73dcd >2013-12-09 04:02:02,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f781ffc >2013-12-09 04:02:02,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f781ffc >2013-12-09 04:02:02,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3359111d >2013-12-09 04:02:03,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3359111d >2013-12-09 04:02:06,028 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-98) No up server in cluster >2013-12-09 04:02:06,029 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-98) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:02:06,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9df2a7c >2013-12-09 04:02:06,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterTasksListVDSCommand, return: [], log id: 9df2a7c >2013-12-09 04:02:08,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 590fac0f >2013-12-09 04:02:08,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 590fac0f >2013-12-09 04:02:08,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e41ad8c >2013-12-09 04:02:08,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e41ad8c >2013-12-09 04:02:13,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 191abcad >2013-12-09 04:02:14,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 191abcad >2013-12-09 04:02:14,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59487a8b >2013-12-09 04:02:14,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59487a8b >2013-12-09 04:02:19,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 561ac761 >2013-12-09 04:02:20,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 561ac761 >2013-12-09 04:02:20,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e37184c >2013-12-09 04:02:20,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e37184c >2013-12-09 04:02:25,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 271e6e7b >2013-12-09 04:02:25,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 271e6e7b >2013-12-09 04:02:25,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 563d9203 >2013-12-09 04:02:26,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 563d9203 >2013-12-09 04:02:31,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40b37a5a >2013-12-09 04:02:31,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 40b37a5a >2013-12-09 04:02:31,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3806f8f3 >2013-12-09 04:02:32,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3806f8f3 >2013-12-09 04:02:37,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6100f658 >2013-12-09 04:02:37,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6100f658 >2013-12-09 04:02:37,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c6c3ce2 >2013-12-09 04:02:37,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c6c3ce2 >2013-12-09 04:02:42,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e8bdf97 >2013-12-09 04:02:43,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e8bdf97 >2013-12-09 04:02:43,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69d9ca86 >2013-12-09 04:02:43,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69d9ca86 >2013-12-09 04:02:48,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c938c3c >2013-12-09 04:02:49,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c938c3c >2013-12-09 04:02:49,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 527ebd95 >2013-12-09 04:02:49,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 527ebd95 >2013-12-09 04:02:54,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79fc4250 >2013-12-09 04:02:54,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 79fc4250 >2013-12-09 04:02:54,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d6ee569 >2013-12-09 04:02:55,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d6ee569 >2013-12-09 04:03:00,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4bdf5e6c >2013-12-09 04:03:00,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4bdf5e6c >2013-12-09 04:03:00,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47c3f902 >2013-12-09 04:03:00,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47c3f902 >2013-12-09 04:03:05,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2df8d9e1 >2013-12-09 04:03:06,303 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-75) No up server in cluster >2013-12-09 04:03:06,303 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-75) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:03:06,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a597af2 >2013-12-09 04:03:06,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2df8d9e1 >2013-12-09 04:03:06,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c7eb69f >2013-12-09 04:03:06,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1a597af2 >2013-12-09 04:03:06,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c7eb69f >2013-12-09 04:03:11,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ea5759 >2013-12-09 04:03:12,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ea5759 >2013-12-09 04:03:12,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e868b5b >2013-12-09 04:03:12,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e868b5b >2013-12-09 04:03:17,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f772afe >2013-12-09 04:03:17,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: f772afe >2013-12-09 04:03:17,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2eb08192 >2013-12-09 04:03:18,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2eb08192 >2013-12-09 04:03:23,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b718bc5 >2013-12-09 04:03:23,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b718bc5 >2013-12-09 04:03:23,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77ebdbd3 >2013-12-09 04:03:23,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77ebdbd3 >2013-12-09 04:03:29,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 737a3c63 >2013-12-09 04:03:29,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 737a3c63 >2013-12-09 04:03:29,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4511526a >2013-12-09 04:03:29,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4511526a >2013-12-09 04:03:34,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 719a6953 >2013-12-09 04:03:35,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 719a6953 >2013-12-09 04:03:35,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4245babf >2013-12-09 04:03:35,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4245babf >2013-12-09 04:03:40,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 504ac6f2 >2013-12-09 04:03:41,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 504ac6f2 >2013-12-09 04:03:41,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: dae0641 >2013-12-09 04:03:41,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: dae0641 >2013-12-09 04:03:46,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6affb73b >2013-12-09 04:03:46,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6affb73b >2013-12-09 04:03:46,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6095e053 >2013-12-09 04:03:47,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6095e053 >2013-12-09 04:03:52,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b6a225c >2013-12-09 04:03:52,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b6a225c >2013-12-09 04:03:52,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e41a2ca >2013-12-09 04:03:52,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e41a2ca >2013-12-09 04:03:57,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 236b1d14 >2013-12-09 04:03:58,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 236b1d14 >2013-12-09 04:03:58,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1cde4399 >2013-12-09 04:03:58,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1cde4399 >2013-12-09 04:04:03,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62cae84e >2013-12-09 04:04:04,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 62cae84e >2013-12-09 04:04:04,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4dba64c6 >2013-12-09 04:04:04,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4dba64c6 >2013-12-09 04:04:06,547 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-44) No up server in cluster >2013-12-09 04:04:06,548 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-44) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:04:06,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 671342a2 >2013-12-09 04:04:06,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterTasksListVDSCommand, return: [], log id: 671342a2 >2013-12-09 04:04:09,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77899a57 >2013-12-09 04:04:09,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 77899a57 >2013-12-09 04:04:09,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b43e1fa >2013-12-09 04:04:10,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b43e1fa >2013-12-09 04:04:15,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 399fc29f >2013-12-09 04:04:15,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 399fc29f >2013-12-09 04:04:15,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20d06364 >2013-12-09 04:04:16,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20d06364 >2013-12-09 04:04:21,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4087b4e3 >2013-12-09 04:04:21,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4087b4e3 >2013-12-09 04:04:21,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a61ce7d >2013-12-09 04:04:21,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a61ce7d >2013-12-09 04:04:26,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 284a0c89 >2013-12-09 04:04:27,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 284a0c89 >2013-12-09 04:04:27,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26a01af1 >2013-12-09 04:04:27,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26a01af1 >2013-12-09 04:04:32,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a956c7a >2013-12-09 04:04:33,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a956c7a >2013-12-09 04:04:33,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b5f871d >2013-12-09 04:04:33,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b5f871d >2013-12-09 04:04:38,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 684c9d4c >2013-12-09 04:04:38,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 684c9d4c >2013-12-09 04:04:38,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: bad5fc4 >2013-12-09 04:04:39,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: bad5fc4 >2013-12-09 04:04:44,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41f32a33 >2013-12-09 04:04:44,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 41f32a33 >2013-12-09 04:04:44,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e1d1058 >2013-12-09 04:04:44,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e1d1058 >2013-12-09 04:04:49,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 522da23e >2013-12-09 04:04:50,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 522da23e >2013-12-09 04:04:50,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61cbfcaa >2013-12-09 04:04:50,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61cbfcaa >2013-12-09 04:04:55,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55e17a93 >2013-12-09 04:04:56,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 55e17a93 >2013-12-09 04:04:56,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54b55324 >2013-12-09 04:04:56,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54b55324 >2013-12-09 04:05:01,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 747be301 >2013-12-09 04:05:01,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 747be301 >2013-12-09 04:05:01,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68c23755 >2013-12-09 04:05:02,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68c23755 >2013-12-09 04:05:06,818 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-16) No up server in cluster >2013-12-09 04:05:06,818 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-16) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:05:06,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59f594c4 >2013-12-09 04:05:07,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterTasksListVDSCommand, return: [], log id: 59f594c4 >2013-12-09 04:05:07,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 481449d9 >2013-12-09 04:05:07,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 481449d9 >2013-12-09 04:05:07,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70a4d357 >2013-12-09 04:05:08,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70a4d357 >2013-12-09 04:05:13,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58be63b9 >2013-12-09 04:05:13,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 58be63b9 >2013-12-09 04:05:13,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f499a46 >2013-12-09 04:05:13,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f499a46 >2013-12-09 04:05:18,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67e6baa1 >2013-12-09 04:05:19,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 67e6baa1 >2013-12-09 04:05:19,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5821014b >2013-12-09 04:05:19,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5821014b >2013-12-09 04:05:24,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1dd65363 >2013-12-09 04:05:25,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1dd65363 >2013-12-09 04:05:25,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f141de8 >2013-12-09 04:05:25,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f141de8 >2013-12-09 04:05:30,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4bf1ce06 >2013-12-09 04:05:30,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4bf1ce06 >2013-12-09 04:05:30,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bc72db5 >2013-12-09 04:05:31,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bc72db5 >2013-12-09 04:05:36,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66458f0d >2013-12-09 04:05:36,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 66458f0d >2013-12-09 04:05:36,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6813f276 >2013-12-09 04:05:36,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6813f276 >2013-12-09 04:05:41,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ec0fd48 >2013-12-09 04:05:42,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6ec0fd48 >2013-12-09 04:05:42,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75a6a51e >2013-12-09 04:05:42,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75a6a51e >2013-12-09 04:05:47,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41ff02ab >2013-12-09 04:05:48,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 41ff02ab >2013-12-09 04:05:48,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45fa1edd >2013-12-09 04:05:48,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45fa1edd >2013-12-09 04:05:53,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 114b2282 >2013-12-09 04:05:53,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 114b2282 >2013-12-09 04:05:53,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2cd7ef77 >2013-12-09 04:05:54,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2cd7ef77 >2013-12-09 04:05:59,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d4df26 >2013-12-09 04:05:59,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d4df26 >2013-12-09 04:05:59,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29bf49d4 >2013-12-09 04:05:59,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29bf49d4 >2013-12-09 04:06:04,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64e9003f >2013-12-09 04:06:05,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 64e9003f >2013-12-09 04:06:05,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 770ac55f >2013-12-09 04:06:05,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 770ac55f >2013-12-09 04:06:07,090 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-35) No up server in cluster >2013-12-09 04:06:07,090 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-35) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:06:07,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59239e04 >2013-12-09 04:06:07,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterTasksListVDSCommand, return: [], log id: 59239e04 >2013-12-09 04:06:10,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9db634d >2013-12-09 04:06:11,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 9db634d >2013-12-09 04:06:11,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5614a9e6 >2013-12-09 04:06:11,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5614a9e6 >2013-12-09 04:06:16,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3bf64468 >2013-12-09 04:06:17,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3bf64468 >2013-12-09 04:06:17,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 44cffc6c >2013-12-09 04:06:17,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44cffc6c >2013-12-09 04:06:22,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 635f818c >2013-12-09 04:06:22,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 635f818c >2013-12-09 04:06:22,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50524741 >2013-12-09 04:06:23,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50524741 >2013-12-09 04:06:28,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71ee7c28 >2013-12-09 04:06:28,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 71ee7c28 >2013-12-09 04:06:28,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ac9acd9 >2013-12-09 04:06:28,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ac9acd9 >2013-12-09 04:06:33,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c8c3090 >2013-12-09 04:06:34,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6c8c3090 >2013-12-09 04:06:34,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5697b48d >2013-12-09 04:06:34,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5697b48d >2013-12-09 04:06:39,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11f7c1be >2013-12-09 04:06:40,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 11f7c1be >2013-12-09 04:06:40,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 470f9a4f >2013-12-09 04:06:40,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 470f9a4f >2013-12-09 04:06:45,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11bb4962 >2013-12-09 04:06:45,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 11bb4962 >2013-12-09 04:06:45,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63d57141 >2013-12-09 04:06:46,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63d57141 >2013-12-09 04:06:51,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d921cbc >2013-12-09 04:06:51,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: d921cbc >2013-12-09 04:06:51,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 383760d0 >2013-12-09 04:06:51,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 383760d0 >2013-12-09 04:06:56,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 674e3b12 >2013-12-09 04:06:57,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 674e3b12 >2013-12-09 04:06:57,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23438f86 >2013-12-09 04:06:57,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23438f86 >2013-12-09 04:07:02,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33871ac2 >2013-12-09 04:07:03,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 33871ac2 >2013-12-09 04:07:03,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 673d31b9 >2013-12-09 04:07:03,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 673d31b9 >2013-12-09 04:07:07,380 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-25) No up server in cluster >2013-12-09 04:07:07,380 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-25) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:07:07,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7835c2f4 >2013-12-09 04:07:07,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7835c2f4 >2013-12-09 04:07:08,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e7ad2d8 >2013-12-09 04:07:09,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e7ad2d8 >2013-12-09 04:07:09,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d1a0961 >2013-12-09 04:07:09,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d1a0961 >2013-12-09 04:07:14,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30f346b7 >2013-12-09 04:07:14,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 30f346b7 >2013-12-09 04:07:14,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12440621 >2013-12-09 04:07:15,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12440621 >2013-12-09 04:07:20,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f0da4fd >2013-12-09 04:07:20,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f0da4fd >2013-12-09 04:07:20,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 717c252 >2013-12-09 04:07:20,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 717c252 >2013-12-09 04:07:25,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49ef7bf7 >2013-12-09 04:07:26,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 49ef7bf7 >2013-12-09 04:07:26,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b4f87dd >2013-12-09 04:07:26,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b4f87dd >2013-12-09 04:07:31,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c8f6a98 >2013-12-09 04:07:32,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c8f6a98 >2013-12-09 04:07:32,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ba5e038 >2013-12-09 04:07:32,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ba5e038 >2013-12-09 04:07:37,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d786f14 >2013-12-09 04:07:37,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d786f14 >2013-12-09 04:07:37,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 90c76cf >2013-12-09 04:07:38,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 90c76cf >2013-12-09 04:07:43,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c85f289 >2013-12-09 04:07:43,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1c85f289 >2013-12-09 04:07:43,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55812b44 >2013-12-09 04:07:43,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55812b44 >2013-12-09 04:07:49,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 608ab661 >2013-12-09 04:07:49,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 608ab661 >2013-12-09 04:07:49,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4824a0da >2013-12-09 04:07:49,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4824a0da >2013-12-09 04:07:54,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d2e49c5 >2013-12-09 04:07:55,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d2e49c5 >2013-12-09 04:07:55,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9ab8046 >2013-12-09 04:07:55,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9ab8046 >2013-12-09 04:08:00,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f06d125 >2013-12-09 04:08:01,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f06d125 >2013-12-09 04:08:01,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e0d38dd >2013-12-09 04:08:01,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e0d38dd >2013-12-09 04:08:06,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64f9004a >2013-12-09 04:08:06,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 64f9004a >2013-12-09 04:08:06,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d4e23d7 >2013-12-09 04:08:07,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d4e23d7 >2013-12-09 04:08:07,661 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-20) No up server in cluster >2013-12-09 04:08:07,661 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-20) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:08:07,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 658fd700 >2013-12-09 04:08:07,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterTasksListVDSCommand, return: [], log id: 658fd700 >2013-12-09 04:08:12,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a795dc9 >2013-12-09 04:08:12,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1a795dc9 >2013-12-09 04:08:12,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72260f3b >2013-12-09 04:08:12,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72260f3b >2013-12-09 04:08:17,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19a555d2 >2013-12-09 04:08:18,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19a555d2 >2013-12-09 04:08:18,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c92aaa5 >2013-12-09 04:08:18,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c92aaa5 >2013-12-09 04:08:23,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59b287a6 >2013-12-09 04:08:24,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 59b287a6 >2013-12-09 04:08:24,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6902ebd3 >2013-12-09 04:08:24,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6902ebd3 >2013-12-09 04:08:29,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8b578d8 >2013-12-09 04:08:29,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 8b578d8 >2013-12-09 04:08:29,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4efc981e >2013-12-09 04:08:30,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4efc981e >2013-12-09 04:08:35,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64b71d93 >2013-12-09 04:08:35,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 64b71d93 >2013-12-09 04:08:35,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f9ce155 >2013-12-09 04:08:36,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f9ce155 >2013-12-09 04:08:41,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: da3c5da >2013-12-09 04:08:41,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: da3c5da >2013-12-09 04:08:41,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4bc1a6cd >2013-12-09 04:08:41,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4bc1a6cd >2013-12-09 04:08:46,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 435c6de1 >2013-12-09 04:08:47,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 435c6de1 >2013-12-09 04:08:47,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 22fc6ef5 >2013-12-09 04:08:47,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22fc6ef5 >2013-12-09 04:08:52,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e68c581 >2013-12-09 04:08:53,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6e68c581 >2013-12-09 04:08:53,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d704d5e >2013-12-09 04:08:53,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d704d5e >2013-12-09 04:08:58,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a3ea6ae >2013-12-09 04:08:58,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2a3ea6ae >2013-12-09 04:08:58,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 673afd >2013-12-09 04:08:59,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 673afd >2013-12-09 04:09:04,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 379ff5d0 >2013-12-09 04:09:04,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 379ff5d0 >2013-12-09 04:09:04,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2cbb9731 >2013-12-09 04:09:04,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2cbb9731 >2013-12-09 04:09:07,936 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-5) No up server in cluster >2013-12-09 04:09:07,936 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-5) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:09:07,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36a7fefa >2013-12-09 04:09:08,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterTasksListVDSCommand, return: [], log id: 36a7fefa >2013-12-09 04:09:09,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 564b055d >2013-12-09 04:09:10,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 564b055d >2013-12-09 04:09:10,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 434d3eb0 >2013-12-09 04:09:10,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 434d3eb0 >2013-12-09 04:09:15,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a168d9f >2013-12-09 04:09:16,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4a168d9f >2013-12-09 04:09:16,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b1afbe0 >2013-12-09 04:09:16,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b1afbe0 >2013-12-09 04:09:21,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ad9ce65 >2013-12-09 04:09:21,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4ad9ce65 >2013-12-09 04:09:21,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c670fd7 >2013-12-09 04:09:22,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c670fd7 >2013-12-09 04:09:27,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75dd8f09 >2013-12-09 04:09:27,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 75dd8f09 >2013-12-09 04:09:27,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28cf2c85 >2013-12-09 04:09:28,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28cf2c85 >2013-12-09 04:09:33,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 44388b2b >2013-12-09 04:09:33,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 44388b2b >2013-12-09 04:09:33,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b7e840e >2013-12-09 04:09:33,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b7e840e >2013-12-09 04:09:38,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 557fa465 >2013-12-09 04:09:39,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 557fa465 >2013-12-09 04:09:39,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63e32e69 >2013-12-09 04:09:39,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63e32e69 >2013-12-09 04:09:44,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4db88fb1 >2013-12-09 04:09:45,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4db88fb1 >2013-12-09 04:09:45,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5fcb28e8 >2013-12-09 04:09:45,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fcb28e8 >2013-12-09 04:09:50,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f5e1cb8 >2013-12-09 04:09:50,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f5e1cb8 >2013-12-09 04:09:50,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12d8af4d >2013-12-09 04:09:51,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12d8af4d >2013-12-09 04:09:56,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3996179 >2013-12-09 04:09:56,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3996179 >2013-12-09 04:09:56,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e896aa7 >2013-12-09 04:09:56,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e896aa7 >2013-12-09 04:10:01,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e6fa1c1 >2013-12-09 04:10:02,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e6fa1c1 >2013-12-09 04:10:02,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 760ef518 >2013-12-09 04:10:02,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 760ef518 >2013-12-09 04:10:07,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 602b15be >2013-12-09 04:10:08,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 602b15be >2013-12-09 04:10:08,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 740c27e4 >2013-12-09 04:10:08,210 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-96) No up server in cluster >2013-12-09 04:10:08,210 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-96) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:10:08,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17b64b5f >2013-12-09 04:10:08,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 740c27e4 >2013-12-09 04:10:08,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterTasksListVDSCommand, return: [], log id: 17b64b5f >2013-12-09 04:10:13,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b3c29d3 >2013-12-09 04:10:13,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b3c29d3 >2013-12-09 04:10:13,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d49df22 >2013-12-09 04:10:14,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d49df22 >2013-12-09 04:10:19,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3af7d131 >2013-12-09 04:10:19,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3af7d131 >2013-12-09 04:10:19,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2608f2a2 >2013-12-09 04:10:19,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2608f2a2 >2013-12-09 04:10:24,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69bbac29 >2013-12-09 04:10:25,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 69bbac29 >2013-12-09 04:10:25,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6282d06d >2013-12-09 04:10:25,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6282d06d >2013-12-09 04:10:30,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3db84606 >2013-12-09 04:10:31,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3db84606 >2013-12-09 04:10:31,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 510d8f14 >2013-12-09 04:10:31,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 510d8f14 >2013-12-09 04:10:36,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60880c8b >2013-12-09 04:10:37,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 60880c8b >2013-12-09 04:10:37,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29641f07 >2013-12-09 04:10:37,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29641f07 >2013-12-09 04:10:42,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73c4a0df >2013-12-09 04:10:42,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 73c4a0df >2013-12-09 04:10:42,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8b90475 >2013-12-09 04:10:43,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8b90475 >2013-12-09 04:10:48,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4321fd8c >2013-12-09 04:10:48,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4321fd8c >2013-12-09 04:10:48,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 799f12a2 >2013-12-09 04:10:48,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 799f12a2 >2013-12-09 04:10:53,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70fc24f7 >2013-12-09 04:10:54,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 70fc24f7 >2013-12-09 04:10:54,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 161b8b43 >2013-12-09 04:10:54,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 161b8b43 >2013-12-09 04:10:59,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11354976 >2013-12-09 04:11:00,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 11354976 >2013-12-09 04:11:00,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7bda87a3 >2013-12-09 04:11:00,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7bda87a3 >2013-12-09 04:11:05,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33b6b53e >2013-12-09 04:11:05,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 33b6b53e >2013-12-09 04:11:05,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f28623d >2013-12-09 04:11:06,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f28623d >2013-12-09 04:11:08,475 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-4) No up server in cluster >2013-12-09 04:11:08,475 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-4) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:11:08,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e67495d >2013-12-09 04:11:08,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2e67495d >2013-12-09 04:11:11,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ea1d580 >2013-12-09 04:11:11,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ea1d580 >2013-12-09 04:11:11,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21f1ed04 >2013-12-09 04:11:12,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21f1ed04 >2013-12-09 04:11:17,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 935846e >2013-12-09 04:11:17,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 935846e >2013-12-09 04:11:17,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57ebf43c >2013-12-09 04:11:17,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57ebf43c >2013-12-09 04:11:22,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51238bc9 >2013-12-09 04:11:23,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 51238bc9 >2013-12-09 04:11:23,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d7b33af >2013-12-09 04:11:23,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d7b33af >2013-12-09 04:11:28,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31b9087f >2013-12-09 04:11:29,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 31b9087f >2013-12-09 04:11:29,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19f46d8 >2013-12-09 04:11:29,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19f46d8 >2013-12-09 04:11:34,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 676a06d0 >2013-12-09 04:11:34,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 676a06d0 >2013-12-09 04:11:34,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30e86238 >2013-12-09 04:11:35,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30e86238 >2013-12-09 04:11:40,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42cab04 >2013-12-09 04:11:40,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42cab04 >2013-12-09 04:11:40,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3383114a >2013-12-09 04:11:40,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3383114a >2013-12-09 04:11:45,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 106e53f2 >2013-12-09 04:11:46,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 106e53f2 >2013-12-09 04:11:46,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ee2a7bd >2013-12-09 04:11:46,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ee2a7bd >2013-12-09 04:11:51,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7700745 >2013-12-09 04:11:52,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7700745 >2013-12-09 04:11:52,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ef6f24c >2013-12-09 04:11:52,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ef6f24c >2013-12-09 04:11:57,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78fc0837 >2013-12-09 04:11:57,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 78fc0837 >2013-12-09 04:11:57,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1940ab2a >2013-12-09 04:11:58,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1940ab2a >2013-12-09 04:12:03,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1747a9e7 >2013-12-09 04:12:03,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1747a9e7 >2013-12-09 04:12:03,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6df42b09 >2013-12-09 04:12:03,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6df42b09 >2013-12-09 04:12:08,740 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) No up server in cluster >2013-12-09 04:12:08,741 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:12:08,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59b76426 >2013-12-09 04:12:08,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2166acba >2013-12-09 04:12:09,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterTasksListVDSCommand, return: [], log id: 59b76426 >2013-12-09 04:12:09,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2166acba >2013-12-09 04:12:09,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 633928dc >2013-12-09 04:12:09,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 633928dc >2013-12-09 04:12:14,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d89ca79 >2013-12-09 04:12:15,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5d89ca79 >2013-12-09 04:12:15,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3bc4d66a >2013-12-09 04:12:15,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3bc4d66a >2013-12-09 04:12:20,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 495bcc82 >2013-12-09 04:12:20,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 495bcc82 >2013-12-09 04:12:20,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 786f38d1 >2013-12-09 04:12:21,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 786f38d1 >2013-12-09 04:12:26,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f36e7e7 >2013-12-09 04:12:26,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f36e7e7 >2013-12-09 04:12:26,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a29e916 >2013-12-09 04:12:27,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a29e916 >2013-12-09 04:12:32,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c272917 >2013-12-09 04:12:32,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c272917 >2013-12-09 04:12:32,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 116cb3c7 >2013-12-09 04:12:32,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 116cb3c7 >2013-12-09 04:12:37,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 164b7d9b >2013-12-09 04:12:38,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 164b7d9b >2013-12-09 04:12:38,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7bcdf3dd >2013-12-09 04:12:38,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7bcdf3dd >2013-12-09 04:12:43,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 710c09aa >2013-12-09 04:12:44,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 710c09aa >2013-12-09 04:12:44,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51579c57 >2013-12-09 04:12:44,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51579c57 >2013-12-09 04:12:49,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ea952b2 >2013-12-09 04:12:49,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7ea952b2 >2013-12-09 04:12:49,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ca45f9f >2013-12-09 04:12:50,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ca45f9f >2013-12-09 04:12:55,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6fafb922 >2013-12-09 04:12:55,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6fafb922 >2013-12-09 04:12:55,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d929fff >2013-12-09 04:12:55,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d929fff >2013-12-09 04:13:00,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5871c4ef >2013-12-09 04:13:01,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5871c4ef >2013-12-09 04:13:01,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 761311b6 >2013-12-09 04:13:01,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 761311b6 >2013-12-09 04:13:06,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a463c2b >2013-12-09 04:13:07,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1a463c2b >2013-12-09 04:13:07,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 212bbbbe >2013-12-09 04:13:07,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 212bbbbe >2013-12-09 04:13:09,019 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-54) No up server in cluster >2013-12-09 04:13:09,019 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-54) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:13:09,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23d5ea1 >2013-12-09 04:13:09,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterTasksListVDSCommand, return: [], log id: 23d5ea1 >2013-12-09 04:13:12,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 442d1587 >2013-12-09 04:13:12,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 442d1587 >2013-12-09 04:13:12,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11adbad >2013-12-09 04:13:13,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11adbad >2013-12-09 04:13:18,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 223c20f0 >2013-12-09 04:13:18,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 223c20f0 >2013-12-09 04:13:18,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e874c5c >2013-12-09 04:13:18,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e874c5c >2013-12-09 04:13:23,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b00b4dc >2013-12-09 04:13:24,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b00b4dc >2013-12-09 04:13:24,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6cd2dba4 >2013-12-09 04:13:24,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6cd2dba4 >2013-12-09 04:13:29,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2644d3fb >2013-12-09 04:13:30,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2644d3fb >2013-12-09 04:13:30,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3394b50b >2013-12-09 04:13:30,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3394b50b >2013-12-09 04:13:35,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68e3c042 >2013-12-09 04:13:36,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 68e3c042 >2013-12-09 04:13:36,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41d998b0 >2013-12-09 04:13:36,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41d998b0 >2013-12-09 04:13:41,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b5acdfe >2013-12-09 04:13:41,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b5acdfe >2013-12-09 04:13:41,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ba673f >2013-12-09 04:13:42,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ba673f >2013-12-09 04:13:47,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 14899dfc >2013-12-09 04:13:47,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 14899dfc >2013-12-09 04:13:47,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35fb039b >2013-12-09 04:13:47,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35fb039b >2013-12-09 04:13:52,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61c0ae00 >2013-12-09 04:13:53,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 61c0ae00 >2013-12-09 04:13:53,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d0ab9ec >2013-12-09 04:13:53,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d0ab9ec >2013-12-09 04:13:58,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6775271 >2013-12-09 04:13:59,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6775271 >2013-12-09 04:13:59,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c9cc7bb >2013-12-09 04:13:59,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c9cc7bb >2013-12-09 04:14:04,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20285958 >2013-12-09 04:14:04,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 20285958 >2013-12-09 04:14:04,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ff6f74f >2013-12-09 04:14:05,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ff6f74f >2013-12-09 04:14:09,318 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-46) No up server in cluster >2013-12-09 04:14:09,318 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-46) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:14:09,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55f20938 >2013-12-09 04:14:09,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterTasksListVDSCommand, return: [], log id: 55f20938 >2013-12-09 04:14:10,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ce77e99 >2013-12-09 04:14:10,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ce77e99 >2013-12-09 04:14:10,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f8fd5ac >2013-12-09 04:14:10,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f8fd5ac >2013-12-09 04:14:15,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62c60156 >2013-12-09 04:14:16,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 62c60156 >2013-12-09 04:14:16,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4dfe1676 >2013-12-09 04:14:16,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4dfe1676 >2013-12-09 04:14:21,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 161d8ef1 >2013-12-09 04:14:22,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 161d8ef1 >2013-12-09 04:14:22,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57991ea6 >2013-12-09 04:14:22,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57991ea6 >2013-12-09 04:14:27,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f464998 >2013-12-09 04:14:28,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5f464998 >2013-12-09 04:14:28,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2dc78a4 >2013-12-09 04:14:28,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2dc78a4 >2013-12-09 04:14:33,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69b39aee >2013-12-09 04:14:33,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 69b39aee >2013-12-09 04:14:33,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5eb5bd4b >2013-12-09 04:14:34,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5eb5bd4b >2013-12-09 04:14:39,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 609dbe66 >2013-12-09 04:14:39,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 609dbe66 >2013-12-09 04:14:39,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 24fe2e11 >2013-12-09 04:14:39,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24fe2e11 >2013-12-09 04:14:44,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3abeb4ab >2013-12-09 04:14:45,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3abeb4ab >2013-12-09 04:14:45,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f52e492 >2013-12-09 04:14:45,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f52e492 >2013-12-09 04:14:50,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35e76107 >2013-12-09 04:14:51,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 35e76107 >2013-12-09 04:14:51,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a6a644 >2013-12-09 04:14:51,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a6a644 >2013-12-09 04:14:56,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11281d64 >2013-12-09 04:14:56,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 11281d64 >2013-12-09 04:14:56,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 299fae60 >2013-12-09 04:14:57,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 299fae60 >2013-12-09 04:15:02,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66566029 >2013-12-09 04:15:02,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 66566029 >2013-12-09 04:15:02,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a66ffd7 >2013-12-09 04:15:02,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a66ffd7 >2013-12-09 04:15:07,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7646876d >2013-12-09 04:15:08,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7646876d >2013-12-09 04:15:08,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a78b2c4 >2013-12-09 04:15:08,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a78b2c4 >2013-12-09 04:15:09,598 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-23) No up server in cluster >2013-12-09 04:15:09,598 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-23) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:15:09,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 746542b9 >2013-12-09 04:15:09,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterTasksListVDSCommand, return: [], log id: 746542b9 >2013-12-09 04:15:13,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c196939 >2013-12-09 04:15:14,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4c196939 >2013-12-09 04:15:14,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77eead15 >2013-12-09 04:15:14,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77eead15 >2013-12-09 04:15:19,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b123905 >2013-12-09 04:15:20,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6b123905 >2013-12-09 04:15:20,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71537f69 >2013-12-09 04:15:20,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71537f69 >2013-12-09 04:15:25,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24b38afe >2013-12-09 04:15:25,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 24b38afe >2013-12-09 04:15:25,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e0c246a >2013-12-09 04:15:26,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e0c246a >2013-12-09 04:15:31,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f9b7223 >2013-12-09 04:15:31,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f9b7223 >2013-12-09 04:15:31,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f756567 >2013-12-09 04:15:31,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f756567 >2013-12-09 04:15:36,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53dfbd67 >2013-12-09 04:15:37,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 53dfbd67 >2013-12-09 04:15:37,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53ca17e4 >2013-12-09 04:15:37,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53ca17e4 >2013-12-09 04:15:42,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 176c288e >2013-12-09 04:15:43,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 176c288e >2013-12-09 04:15:43,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f06fbc7 >2013-12-09 04:15:43,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f06fbc7 >2013-12-09 04:15:48,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 625cb7fd >2013-12-09 04:15:48,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 625cb7fd >2013-12-09 04:15:48,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5dc78840 >2013-12-09 04:15:49,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5dc78840 >2013-12-09 04:15:54,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4cfb1799 >2013-12-09 04:15:54,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4cfb1799 >2013-12-09 04:15:54,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d8692cd >2013-12-09 04:15:54,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d8692cd >2013-12-09 04:15:59,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6de6c9a3 >2013-12-09 04:16:00,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6de6c9a3 >2013-12-09 04:16:00,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b694e1 >2013-12-09 04:16:00,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b694e1 >2013-12-09 04:16:05,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fde77c7 >2013-12-09 04:16:06,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2fde77c7 >2013-12-09 04:16:06,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63278897 >2013-12-09 04:16:06,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63278897 >2013-12-09 04:16:09,895 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-73) No up server in cluster >2013-12-09 04:16:09,895 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-73) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:16:09,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 479d7b11 >2013-12-09 04:16:10,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterTasksListVDSCommand, return: [], log id: 479d7b11 >2013-12-09 04:16:11,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 592ecfe3 >2013-12-09 04:16:12,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 592ecfe3 >2013-12-09 04:16:12,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 141bdf86 >2013-12-09 04:16:12,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 141bdf86 >2013-12-09 04:16:17,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d90505d >2013-12-09 04:16:17,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2d90505d >2013-12-09 04:16:17,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a3820dd >2013-12-09 04:16:18,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a3820dd >2013-12-09 04:16:23,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 24721968 >2013-12-09 04:16:23,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 24721968 >2013-12-09 04:16:23,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d078b98 >2013-12-09 04:16:23,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d078b98 >2013-12-09 04:16:28,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7290a68f >2013-12-09 04:16:29,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7290a68f >2013-12-09 04:16:29,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c7cc329 >2013-12-09 04:16:29,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c7cc329 >2013-12-09 04:16:34,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33a0b563 >2013-12-09 04:16:35,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 33a0b563 >2013-12-09 04:16:35,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72d9ab0d >2013-12-09 04:16:35,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72d9ab0d >2013-12-09 04:16:40,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75590c95 >2013-12-09 04:16:40,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 75590c95 >2013-12-09 04:16:40,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b7c8fd2 >2013-12-09 04:16:41,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b7c8fd2 >2013-12-09 04:16:46,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e8549c8 >2013-12-09 04:16:46,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6e8549c8 >2013-12-09 04:16:46,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76abda3d >2013-12-09 04:16:46,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76abda3d >2013-12-09 04:16:51,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3fc67bff >2013-12-09 04:16:52,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3fc67bff >2013-12-09 04:16:52,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c9b876d >2013-12-09 04:16:52,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c9b876d >2013-12-09 04:16:57,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6222c41a >2013-12-09 04:16:58,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6222c41a >2013-12-09 04:16:58,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21e775fa >2013-12-09 04:16:58,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21e775fa >2013-12-09 04:17:03,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7832cdb4 >2013-12-09 04:17:03,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7832cdb4 >2013-12-09 04:17:03,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5627ef83 >2013-12-09 04:17:04,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5627ef83 >2013-12-09 04:17:09,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18bb6f3e >2013-12-09 04:17:09,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 18bb6f3e >2013-12-09 04:17:09,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e6665cb >2013-12-09 04:17:10,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e6665cb >2013-12-09 04:17:10,176 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-61) No up server in cluster >2013-12-09 04:17:10,176 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-61) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:17:10,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d4ca59 >2013-12-09 04:17:10,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4d4ca59 >2013-12-09 04:17:15,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 254e07d8 >2013-12-09 04:17:15,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 254e07d8 >2013-12-09 04:17:15,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d6147e >2013-12-09 04:17:15,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d6147e >2013-12-09 04:17:20,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 788e1724 >2013-12-09 04:17:21,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 788e1724 >2013-12-09 04:17:21,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c22cf3b >2013-12-09 04:17:21,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c22cf3b >2013-12-09 04:17:26,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 503770a >2013-12-09 04:17:27,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 503770a >2013-12-09 04:17:27,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 218f0b79 >2013-12-09 04:17:27,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 218f0b79 >2013-12-09 04:17:32,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1384cd78 >2013-12-09 04:17:32,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1384cd78 >2013-12-09 04:17:32,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18e933a >2013-12-09 04:17:33,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18e933a >2013-12-09 04:17:38,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d747a3b >2013-12-09 04:17:38,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d747a3b >2013-12-09 04:17:38,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 422eb8af >2013-12-09 04:17:38,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 422eb8af >2013-12-09 04:17:43,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 101de3c2 >2013-12-09 04:17:44,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 101de3c2 >2013-12-09 04:17:44,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75e4f9ee >2013-12-09 04:17:44,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75e4f9ee >2013-12-09 04:17:49,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58c30fad >2013-12-09 04:17:50,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 58c30fad >2013-12-09 04:17:50,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b58084 >2013-12-09 04:17:50,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b58084 >2013-12-09 04:17:55,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 460decd1 >2013-12-09 04:17:55,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 460decd1 >2013-12-09 04:17:55,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70fe9e43 >2013-12-09 04:17:56,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70fe9e43 >2013-12-09 04:18:01,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 190b4b21 >2013-12-09 04:18:01,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 190b4b21 >2013-12-09 04:18:01,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 451eb415 >2013-12-09 04:18:01,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 451eb415 >2013-12-09 04:18:06,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4810bbfa >2013-12-09 04:18:07,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4810bbfa >2013-12-09 04:18:07,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2012a2fd >2013-12-09 04:18:07,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2012a2fd >2013-12-09 04:18:10,457 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-32) No up server in cluster >2013-12-09 04:18:10,457 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-32) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:18:10,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67b25d7b >2013-12-09 04:18:10,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterTasksListVDSCommand, return: [], log id: 67b25d7b >2013-12-09 04:18:12,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b1927aa >2013-12-09 04:18:13,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b1927aa >2013-12-09 04:18:13,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 726032af >2013-12-09 04:18:13,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 726032af >2013-12-09 04:18:18,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11aa97ef >2013-12-09 04:18:19,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 11aa97ef >2013-12-09 04:18:19,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 794eab4d >2013-12-09 04:18:19,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 794eab4d >2013-12-09 04:18:24,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ed9b699 >2013-12-09 04:18:24,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5ed9b699 >2013-12-09 04:18:24,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c4ce0d0 >2013-12-09 04:18:25,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c4ce0d0 >2013-12-09 04:18:30,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d9c0e67 >2013-12-09 04:18:30,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d9c0e67 >2013-12-09 04:18:30,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 126fe244 >2013-12-09 04:18:30,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 126fe244 >2013-12-09 04:18:35,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 415c14ef >2013-12-09 04:18:36,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 415c14ef >2013-12-09 04:18:36,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74151f35 >2013-12-09 04:18:36,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74151f35 >2013-12-09 04:18:41,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e79a8b1 >2013-12-09 04:18:42,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7e79a8b1 >2013-12-09 04:18:42,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3fd5ac32 >2013-12-09 04:18:42,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3fd5ac32 >2013-12-09 04:18:47,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75cd5f8a >2013-12-09 04:18:47,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 75cd5f8a >2013-12-09 04:18:47,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6cc7c66c >2013-12-09 04:18:48,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6cc7c66c >2013-12-09 04:18:53,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5918229 >2013-12-09 04:18:53,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5918229 >2013-12-09 04:18:53,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 694533f5 >2013-12-09 04:18:53,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 694533f5 >2013-12-09 04:18:59,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a4691f4 >2013-12-09 04:18:59,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4a4691f4 >2013-12-09 04:18:59,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 233e7eff >2013-12-09 04:18:59,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 233e7eff >2013-12-09 04:19:04,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 747d35de >2013-12-09 04:19:05,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 747d35de >2013-12-09 04:19:05,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f9a5832 >2013-12-09 04:19:05,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f9a5832 >2013-12-09 04:19:10,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bfbf540 >2013-12-09 04:19:10,737 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) No up server in cluster >2013-12-09 04:19:10,737 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:19:10,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d54189 >2013-12-09 04:19:10,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1d54189 >2013-12-09 04:19:11,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2bfbf540 >2013-12-09 04:19:11,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b3b64fb >2013-12-09 04:19:11,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b3b64fb >2013-12-09 04:19:16,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c93e167 >2013-12-09 04:19:16,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c93e167 >2013-12-09 04:19:16,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36d8532 >2013-12-09 04:19:17,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36d8532 >2013-12-09 04:19:22,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d567f29 >2013-12-09 04:19:22,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d567f29 >2013-12-09 04:19:22,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4db0e55c >2013-12-09 04:19:22,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4db0e55c >2013-12-09 04:19:27,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53928acc >2013-12-09 04:19:28,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 53928acc >2013-12-09 04:19:28,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3032d094 >2013-12-09 04:19:28,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3032d094 >2013-12-09 04:19:33,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17a05832 >2013-12-09 04:19:34,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 17a05832 >2013-12-09 04:19:34,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 146a3b62 >2013-12-09 04:19:34,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 146a3b62 >2013-12-09 04:19:39,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f8c2a30 >2013-12-09 04:19:39,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f8c2a30 >2013-12-09 04:19:39,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16fc7c5b >2013-12-09 04:19:40,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16fc7c5b >2013-12-09 04:19:45,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23aeca92 >2013-12-09 04:19:45,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 23aeca92 >2013-12-09 04:19:45,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b9f6f64 >2013-12-09 04:19:45,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b9f6f64 >2013-12-09 04:19:50,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 517962c8 >2013-12-09 04:19:51,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 517962c8 >2013-12-09 04:19:51,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73551641 >2013-12-09 04:19:51,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73551641 >2013-12-09 04:19:56,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e4da4c2 >2013-12-09 04:19:57,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1e4da4c2 >2013-12-09 04:19:57,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a889a06 >2013-12-09 04:19:57,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a889a06 >2013-12-09 04:20:02,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 499282fe >2013-12-09 04:20:02,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 499282fe >2013-12-09 04:20:02,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c99da5f >2013-12-09 04:20:03,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c99da5f >2013-12-09 04:20:08,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 917afef >2013-12-09 04:20:08,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 917afef >2013-12-09 04:20:08,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 717b531a >2013-12-09 04:20:09,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 717b531a >2013-12-09 04:20:11,004 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-36) No up server in cluster >2013-12-09 04:20:11,004 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-36) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:20:11,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32cc4419 >2013-12-09 04:20:11,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterTasksListVDSCommand, return: [], log id: 32cc4419 >2013-12-09 04:20:14,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b17c2e8 >2013-12-09 04:20:14,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b17c2e8 >2013-12-09 04:20:14,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70018ff3 >2013-12-09 04:20:14,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70018ff3 >2013-12-09 04:20:19,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5af4ae4e >2013-12-09 04:20:20,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5af4ae4e >2013-12-09 04:20:20,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f4dac10 >2013-12-09 04:20:20,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f4dac10 >2013-12-09 04:20:25,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ece500f >2013-12-09 04:20:26,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ece500f >2013-12-09 04:20:26,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1788f33a >2013-12-09 04:20:26,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1788f33a >2013-12-09 04:20:31,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1cdafefb >2013-12-09 04:20:31,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1cdafefb >2013-12-09 04:20:31,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2bd8990c >2013-12-09 04:20:32,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bd8990c >2013-12-09 04:20:37,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3aca72a1 >2013-12-09 04:20:37,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3aca72a1 >2013-12-09 04:20:37,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 482b4600 >2013-12-09 04:20:37,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 482b4600 >2013-12-09 04:20:42,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28022c5 >2013-12-09 04:20:43,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 28022c5 >2013-12-09 04:20:43,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39549fd5 >2013-12-09 04:20:43,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39549fd5 >2013-12-09 04:20:48,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16452e8d >2013-12-09 04:20:49,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 16452e8d >2013-12-09 04:20:49,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39ae0f13 >2013-12-09 04:20:49,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39ae0f13 >2013-12-09 04:20:54,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35abcfea >2013-12-09 04:20:55,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 35abcfea >2013-12-09 04:20:55,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72f76c2 >2013-12-09 04:20:55,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72f76c2 >2013-12-09 04:21:00,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c4d1fe9 >2013-12-09 04:21:00,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4c4d1fe9 >2013-12-09 04:21:00,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f47b621 >2013-12-09 04:21:01,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f47b621 >2013-12-09 04:21:06,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 764dd48a >2013-12-09 04:21:06,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 764dd48a >2013-12-09 04:21:06,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9b708cd >2013-12-09 04:21:06,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9b708cd >2013-12-09 04:21:11,277 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-18) No up server in cluster >2013-12-09 04:21:11,277 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-18) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:21:11,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 778000bf >2013-12-09 04:21:11,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterTasksListVDSCommand, return: [], log id: 778000bf >2013-12-09 04:21:11,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57c9e267 >2013-12-09 04:21:12,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 57c9e267 >2013-12-09 04:21:12,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c4ce314 >2013-12-09 04:21:12,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c4ce314 >2013-12-09 04:21:17,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c5034cc >2013-12-09 04:21:18,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c5034cc >2013-12-09 04:21:18,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4402eb3c >2013-12-09 04:21:18,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4402eb3c >2013-12-09 04:21:23,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 124e0d7e >2013-12-09 04:21:23,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 124e0d7e >2013-12-09 04:21:23,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1840c10 >2013-12-09 04:21:24,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1840c10 >2013-12-09 04:21:29,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66e761e0 >2013-12-09 04:21:29,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 66e761e0 >2013-12-09 04:21:29,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 44cee949 >2013-12-09 04:21:29,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44cee949 >2013-12-09 04:21:34,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e64be7e >2013-12-09 04:21:35,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e64be7e >2013-12-09 04:21:35,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5739a26c >2013-12-09 04:21:35,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5739a26c >2013-12-09 04:21:40,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c37e87e >2013-12-09 04:21:41,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5c37e87e >2013-12-09 04:21:41,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 572902f >2013-12-09 04:21:41,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 572902f >2013-12-09 04:21:46,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1206923d >2013-12-09 04:21:47,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1206923d >2013-12-09 04:21:47,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21302554 >2013-12-09 04:21:47,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21302554 >2013-12-09 04:21:52,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23f4942 >2013-12-09 04:21:52,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 23f4942 >2013-12-09 04:21:52,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 488fc81e >2013-12-09 04:21:53,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 488fc81e >2013-12-09 04:21:58,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 428539a5 >2013-12-09 04:21:58,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 428539a5 >2013-12-09 04:21:58,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75da0326 >2013-12-09 04:21:58,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75da0326 >2013-12-09 04:22:03,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65ad80fa >2013-12-09 04:22:04,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 65ad80fa >2013-12-09 04:22:04,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 654ad3 >2013-12-09 04:22:04,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 654ad3 >2013-12-09 04:22:09,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d8b15ee >2013-12-09 04:22:10,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6d8b15ee >2013-12-09 04:22:10,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e178f3f >2013-12-09 04:22:10,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e178f3f >2013-12-09 04:22:11,578 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-8) No up server in cluster >2013-12-09 04:22:11,578 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-8) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:22:11,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68462073 >2013-12-09 04:22:11,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterTasksListVDSCommand, return: [], log id: 68462073 >2013-12-09 04:22:15,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4933e05d >2013-12-09 04:22:15,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4933e05d >2013-12-09 04:22:15,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f1bf77d >2013-12-09 04:22:16,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f1bf77d >2013-12-09 04:22:21,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 572fe902 >2013-12-09 04:22:21,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 572fe902 >2013-12-09 04:22:21,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7dd3608a >2013-12-09 04:22:21,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7dd3608a >2013-12-09 04:22:26,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 28e7bb6e >2013-12-09 04:22:27,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 28e7bb6e >2013-12-09 04:22:27,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6edbe1aa >2013-12-09 04:22:27,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6edbe1aa >2013-12-09 04:22:32,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10a60b1f >2013-12-09 04:22:33,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 10a60b1f >2013-12-09 04:22:33,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 328987f7 >2013-12-09 04:22:33,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 328987f7 >2013-12-09 04:22:38,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61cfeec2 >2013-12-09 04:22:39,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 61cfeec2 >2013-12-09 04:22:39,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28fa7e06 >2013-12-09 04:22:39,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28fa7e06 >2013-12-09 04:22:44,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 769a18ed >2013-12-09 04:22:44,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 769a18ed >2013-12-09 04:22:44,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a27c2d0 >2013-12-09 04:22:45,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a27c2d0 >2013-12-09 04:22:50,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c76779e >2013-12-09 04:22:50,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4c76779e >2013-12-09 04:22:50,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4fc85174 >2013-12-09 04:22:50,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fc85174 >2013-12-09 04:22:55,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58e88e71 >2013-12-09 04:22:56,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 58e88e71 >2013-12-09 04:22:56,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d758a0 >2013-12-09 04:22:56,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d758a0 >2013-12-09 04:23:01,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e673b1b >2013-12-09 04:23:02,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3e673b1b >2013-12-09 04:23:02,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 699226f >2013-12-09 04:23:02,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 699226f >2013-12-09 04:23:07,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 457d6b3b >2013-12-09 04:23:07,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 457d6b3b >2013-12-09 04:23:07,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e4e2e42 >2013-12-09 04:23:08,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e4e2e42 >2013-12-09 04:23:11,859 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) No up server in cluster >2013-12-09 04:23:11,859 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:23:11,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3621b5e >2013-12-09 04:23:12,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3621b5e >2013-12-09 04:23:13,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 759f6ccc >2013-12-09 04:23:13,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 759f6ccc >2013-12-09 04:23:13,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5347d8b9 >2013-12-09 04:23:13,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5347d8b9 >2013-12-09 04:23:18,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2afaff1b >2013-12-09 04:23:19,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2afaff1b >2013-12-09 04:23:19,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7bf39352 >2013-12-09 04:23:19,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7bf39352 >2013-12-09 04:23:24,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3453a619 >2013-12-09 04:23:25,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3453a619 >2013-12-09 04:23:25,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5bfce994 >2013-12-09 04:23:25,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5bfce994 >2013-12-09 04:23:30,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 230cd623 >2013-12-09 04:23:31,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 230cd623 >2013-12-09 04:23:31,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5263cd3b >2013-12-09 04:23:31,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5263cd3b >2013-12-09 04:23:36,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75825a94 >2013-12-09 04:23:36,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 75825a94 >2013-12-09 04:23:36,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 224551b1 >2013-12-09 04:23:37,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 224551b1 >2013-12-09 04:23:42,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 278ce45c >2013-12-09 04:23:42,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 278ce45c >2013-12-09 04:23:42,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31dfa815 >2013-12-09 04:23:42,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31dfa815 >2013-12-09 04:23:47,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e819aaf >2013-12-09 04:23:48,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2e819aaf >2013-12-09 04:23:48,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4346300c >2013-12-09 04:23:48,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4346300c >2013-12-09 04:23:53,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11066830 >2013-12-09 04:23:54,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 11066830 >2013-12-09 04:23:54,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 134539a1 >2013-12-09 04:23:54,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 134539a1 >2013-12-09 04:23:59,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3edd6638 >2013-12-09 04:23:59,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3edd6638 >2013-12-09 04:23:59,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78d8e53e >2013-12-09 04:24:00,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78d8e53e >2013-12-09 04:24:05,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62aabdc8 >2013-12-09 04:24:05,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 62aabdc8 >2013-12-09 04:24:05,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40ab5fac >2013-12-09 04:24:06,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40ab5fac >2013-12-09 04:24:11,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d508c92 >2013-12-09 04:24:11,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d508c92 >2013-12-09 04:24:11,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33c25608 >2013-12-09 04:24:11,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33c25608 >2013-12-09 04:24:12,147 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-63) No up server in cluster >2013-12-09 04:24:12,148 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-63) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:24:12,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 333448d8 >2013-12-09 04:24:12,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterTasksListVDSCommand, return: [], log id: 333448d8 >2013-12-09 04:24:16,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d516826 >2013-12-09 04:24:17,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d516826 >2013-12-09 04:24:17,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e972ec5 >2013-12-09 04:24:17,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e972ec5 >2013-12-09 04:24:22,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 847c326 >2013-12-09 04:24:23,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 847c326 >2013-12-09 04:24:23,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52b79e14 >2013-12-09 04:24:23,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52b79e14 >2013-12-09 04:24:28,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62f0592 >2013-12-09 04:24:28,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 62f0592 >2013-12-09 04:24:28,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d8a988c >2013-12-09 04:24:29,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d8a988c >2013-12-09 04:24:34,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2cbd58bf >2013-12-09 04:24:34,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2cbd58bf >2013-12-09 04:24:34,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37840a0f >2013-12-09 04:24:34,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37840a0f >2013-12-09 04:24:39,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4fb00c03 >2013-12-09 04:24:40,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4fb00c03 >2013-12-09 04:24:40,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 198b704f >2013-12-09 04:24:40,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 198b704f >2013-12-09 04:24:45,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 574ed8c4 >2013-12-09 04:24:46,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 574ed8c4 >2013-12-09 04:24:46,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4945706f >2013-12-09 04:24:46,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4945706f >2013-12-09 04:24:51,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5afe4e71 >2013-12-09 04:24:51,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5afe4e71 >2013-12-09 04:24:51,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2035380d >2013-12-09 04:24:52,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2035380d >2013-12-09 04:24:57,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1014a97a >2013-12-09 04:24:57,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1014a97a >2013-12-09 04:24:57,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a663e76 >2013-12-09 04:24:57,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a663e76 >2013-12-09 04:25:03,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 623c1301 >2013-12-09 04:25:03,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 623c1301 >2013-12-09 04:25:03,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7bd3753d >2013-12-09 04:25:03,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7bd3753d >2013-12-09 04:25:08,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 359067e1 >2013-12-09 04:25:09,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 359067e1 >2013-12-09 04:25:09,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3343a612 >2013-12-09 04:25:09,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3343a612 >2013-12-09 04:25:12,417 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-95) No up server in cluster >2013-12-09 04:25:12,417 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-95) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:25:12,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 642771a >2013-12-09 04:25:12,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterTasksListVDSCommand, return: [], log id: 642771a >2013-12-09 04:25:14,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 583a4092 >2013-12-09 04:25:15,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 583a4092 >2013-12-09 04:25:15,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: abff86d >2013-12-09 04:25:15,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: abff86d >2013-12-09 04:25:20,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4dec27fa >2013-12-09 04:25:20,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4dec27fa >2013-12-09 04:25:20,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ba5548e >2013-12-09 04:25:21,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ba5548e >2013-12-09 04:25:26,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63085861 >2013-12-09 04:25:26,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 63085861 >2013-12-09 04:25:26,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c8ba479 >2013-12-09 04:25:26,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c8ba479 >2013-12-09 04:25:31,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 390b9375 >2013-12-09 04:25:32,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 390b9375 >2013-12-09 04:25:32,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 660f0a07 >2013-12-09 04:25:32,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 660f0a07 >2013-12-09 04:25:37,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2609307f >2013-12-09 04:25:38,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2609307f >2013-12-09 04:25:38,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 536eda56 >2013-12-09 04:25:38,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 536eda56 >2013-12-09 04:25:43,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b521309 >2013-12-09 04:25:43,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b521309 >2013-12-09 04:25:43,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 593dae04 >2013-12-09 04:25:44,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 593dae04 >2013-12-09 04:25:49,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e83f693 >2013-12-09 04:25:49,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e83f693 >2013-12-09 04:25:49,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 627991d8 >2013-12-09 04:25:49,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 627991d8 >2013-12-09 04:25:55,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36f69869 >2013-12-09 04:25:55,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 36f69869 >2013-12-09 04:25:55,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a182e1f >2013-12-09 04:25:55,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a182e1f >2013-12-09 04:26:00,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13bc6915 >2013-12-09 04:26:01,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 13bc6915 >2013-12-09 04:26:01,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2956a352 >2013-12-09 04:26:01,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2956a352 >2013-12-09 04:26:06,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49af93fb >2013-12-09 04:26:07,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 49af93fb >2013-12-09 04:26:07,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26cb1582 >2013-12-09 04:26:07,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26cb1582 >2013-12-09 04:26:12,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76be6188 >2013-12-09 04:26:12,703 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-72) No up server in cluster >2013-12-09 04:26:12,703 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-72) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:26:12,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 740ce6ac >2013-12-09 04:26:12,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 76be6188 >2013-12-09 04:26:12,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4224c49e >2013-12-09 04:26:12,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterTasksListVDSCommand, return: [], log id: 740ce6ac >2013-12-09 04:26:13,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4224c49e >2013-12-09 04:26:18,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4942cb01 >2013-12-09 04:26:18,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4942cb01 >2013-12-09 04:26:18,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c610c12 >2013-12-09 04:26:18,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c610c12 >2013-12-09 04:26:23,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20dc3d0 >2013-12-09 04:26:24,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 20dc3d0 >2013-12-09 04:26:24,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 785e934f >2013-12-09 04:26:24,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 785e934f >2013-12-09 04:26:29,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fb1c7cb >2013-12-09 04:26:30,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2fb1c7cb >2013-12-09 04:26:30,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5fa6708c >2013-12-09 04:26:30,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fa6708c >2013-12-09 04:26:35,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7aff7395 >2013-12-09 04:26:35,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7aff7395 >2013-12-09 04:26:35,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e0f30b4 >2013-12-09 04:26:36,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e0f30b4 >2013-12-09 04:26:41,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 281b1a16 >2013-12-09 04:26:41,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 281b1a16 >2013-12-09 04:26:41,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2fc3d449 >2013-12-09 04:26:41,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2fc3d449 >2013-12-09 04:26:46,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8a60a30 >2013-12-09 04:26:47,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 8a60a30 >2013-12-09 04:26:47,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10ef42f0 >2013-12-09 04:26:47,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10ef42f0 >2013-12-09 04:26:52,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d002d33 >2013-12-09 04:26:53,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d002d33 >2013-12-09 04:26:53,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: df7818d >2013-12-09 04:26:53,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: df7818d >2013-12-09 04:26:58,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3396dc54 >2013-12-09 04:26:59,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3396dc54 >2013-12-09 04:26:59,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 631414b >2013-12-09 04:26:59,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 631414b >2013-12-09 04:27:04,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 350de817 >2013-12-09 04:27:04,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 350de817 >2013-12-09 04:27:04,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e22144a >2013-12-09 04:27:05,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e22144a >2013-12-09 04:27:10,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a04409d >2013-12-09 04:27:10,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7a04409d >2013-12-09 04:27:10,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 15ea30d8 >2013-12-09 04:27:10,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15ea30d8 >2013-12-09 04:27:12,964 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-30) No up server in cluster >2013-12-09 04:27:12,964 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-30) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:27:12,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b8b3675 >2013-12-09 04:27:13,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7b8b3675 >2013-12-09 04:27:15,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3bc6a3f3 >2013-12-09 04:27:16,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3bc6a3f3 >2013-12-09 04:27:16,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35754386 >2013-12-09 04:27:16,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35754386 >2013-12-09 04:27:21,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73ca3641 >2013-12-09 04:27:22,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 73ca3641 >2013-12-09 04:27:22,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6189b2f7 >2013-12-09 04:27:22,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6189b2f7 >2013-12-09 04:27:27,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38cfb8c9 >2013-12-09 04:27:27,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 38cfb8c9 >2013-12-09 04:27:27,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36d1841a >2013-12-09 04:27:28,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36d1841a >2013-12-09 04:27:33,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62efd620 >2013-12-09 04:27:33,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 62efd620 >2013-12-09 04:27:33,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a75a74f >2013-12-09 04:27:33,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a75a74f >2013-12-09 04:27:38,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b4fa257 >2013-12-09 04:27:39,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b4fa257 >2013-12-09 04:27:39,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5eb4b894 >2013-12-09 04:27:39,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5eb4b894 >2013-12-09 04:27:44,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ac631f8 >2013-12-09 04:27:45,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2ac631f8 >2013-12-09 04:27:45,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e89ff34 >2013-12-09 04:27:45,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e89ff34 >2013-12-09 04:27:50,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c8c13c3 >2013-12-09 04:27:51,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c8c13c3 >2013-12-09 04:27:51,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9d24f26 >2013-12-09 04:27:51,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9d24f26 >2013-12-09 04:27:56,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f671507 >2013-12-09 04:27:56,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: f671507 >2013-12-09 04:27:56,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20d5b0ef >2013-12-09 04:27:57,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20d5b0ef >2013-12-09 04:28:02,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f12535e >2013-12-09 04:28:02,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: f12535e >2013-12-09 04:28:02,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f81ebb1 >2013-12-09 04:28:02,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f81ebb1 >2013-12-09 04:28:07,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44451d3b >2013-12-09 04:28:08,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 44451d3b >2013-12-09 04:28:08,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7063d142 >2013-12-09 04:28:08,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7063d142 >2013-12-09 04:28:13,238 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-64) No up server in cluster >2013-12-09 04:28:13,239 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-64) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:28:13,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41a318b7 >2013-12-09 04:28:13,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterTasksListVDSCommand, return: [], log id: 41a318b7 >2013-12-09 04:28:13,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e749a6 >2013-12-09 04:28:14,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e749a6 >2013-12-09 04:28:14,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73a50de6 >2013-12-09 04:28:14,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73a50de6 >2013-12-09 04:28:19,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: fa02cba >2013-12-09 04:28:19,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: fa02cba >2013-12-09 04:28:19,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f4b8b66 >2013-12-09 04:28:20,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f4b8b66 >2013-12-09 04:28:25,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a99f0f5 >2013-12-09 04:28:25,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3a99f0f5 >2013-12-09 04:28:25,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ecb82e9 >2013-12-09 04:28:26,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ecb82e9 >2013-12-09 04:28:31,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 368242b3 >2013-12-09 04:28:31,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 368242b3 >2013-12-09 04:28:31,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4759bbbd >2013-12-09 04:28:31,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4759bbbd >2013-12-09 04:28:36,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 252c6c53 >2013-12-09 04:28:37,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 252c6c53 >2013-12-09 04:28:37,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7cf8cfd6 >2013-12-09 04:28:37,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7cf8cfd6 >2013-12-09 04:28:42,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41c5ebd5 >2013-12-09 04:28:43,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 41c5ebd5 >2013-12-09 04:28:43,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35258c1d >2013-12-09 04:28:43,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35258c1d >2013-12-09 04:28:48,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 60613f89 >2013-12-09 04:28:48,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 60613f89 >2013-12-09 04:28:48,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f18291d >2013-12-09 04:28:49,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f18291d >2013-12-09 04:28:54,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ab0f796 >2013-12-09 04:28:54,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7ab0f796 >2013-12-09 04:28:54,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73de8d28 >2013-12-09 04:28:54,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73de8d28 >2013-12-09 04:28:59,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2098c729 >2013-12-09 04:29:00,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2098c729 >2013-12-09 04:29:00,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a9ae94f >2013-12-09 04:29:00,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a9ae94f >2013-12-09 04:29:05,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 104553bf >2013-12-09 04:29:06,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 104553bf >2013-12-09 04:29:06,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e253302 >2013-12-09 04:29:06,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e253302 >2013-12-09 04:29:11,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3daf2f57 >2013-12-09 04:29:12,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3daf2f57 >2013-12-09 04:29:12,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b5347bf >2013-12-09 04:29:12,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b5347bf >2013-12-09 04:29:13,513 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-50) No up server in cluster >2013-12-09 04:29:13,513 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-50) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:29:13,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: bd74c22 >2013-12-09 04:29:13,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterTasksListVDSCommand, return: [], log id: bd74c22 >2013-12-09 04:29:17,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 280e9890 >2013-12-09 04:29:17,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 280e9890 >2013-12-09 04:29:17,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c4ec580 >2013-12-09 04:29:18,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c4ec580 >2013-12-09 04:29:23,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e305bb8 >2013-12-09 04:29:23,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e305bb8 >2013-12-09 04:29:23,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37e41cbd >2013-12-09 04:29:23,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37e41cbd >2013-12-09 04:29:28,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e38d1f1 >2013-12-09 04:29:29,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e38d1f1 >2013-12-09 04:29:29,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76c8f92c >2013-12-09 04:29:29,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76c8f92c >2013-12-09 04:29:34,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e7fa72f >2013-12-09 04:29:35,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3e7fa72f >2013-12-09 04:29:35,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d92e3f5 >2013-12-09 04:29:35,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d92e3f5 >2013-12-09 04:29:40,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b4a238b >2013-12-09 04:29:40,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1b4a238b >2013-12-09 04:29:40,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5968c1c2 >2013-12-09 04:29:41,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5968c1c2 >2013-12-09 04:29:46,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42e083b1 >2013-12-09 04:29:46,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42e083b1 >2013-12-09 04:29:46,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7254ff9f >2013-12-09 04:29:46,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7254ff9f >2013-12-09 04:29:51,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31f74a69 >2013-12-09 04:29:52,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 31f74a69 >2013-12-09 04:29:52,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d82f348 >2013-12-09 04:29:52,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d82f348 >2013-12-09 04:29:57,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19b02909 >2013-12-09 04:29:58,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19b02909 >2013-12-09 04:29:58,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26d6a29e >2013-12-09 04:29:58,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26d6a29e >2013-12-09 04:30:03,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5dbe496a >2013-12-09 04:30:03,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5dbe496a >2013-12-09 04:30:03,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e7d1b37 >2013-12-09 04:30:04,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e7d1b37 >2013-12-09 04:30:09,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3fff8558 >2013-12-09 04:30:09,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3fff8558 >2013-12-09 04:30:09,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33356fcb >2013-12-09 04:30:10,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33356fcb >2013-12-09 04:30:13,807 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-12) No up server in cluster >2013-12-09 04:30:13,807 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-12) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:30:13,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5fa6c5e1 >2013-12-09 04:30:14,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5fa6c5e1 >2013-12-09 04:30:15,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4158dcdb >2013-12-09 04:30:15,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4158dcdb >2013-12-09 04:30:15,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 317c2b8c >2013-12-09 04:30:15,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 317c2b8c >2013-12-09 04:30:20,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2956afb9 >2013-12-09 04:30:21,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2956afb9 >2013-12-09 04:30:21,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f94e78 >2013-12-09 04:30:21,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f94e78 >2013-12-09 04:30:26,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d158b6d >2013-12-09 04:30:27,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d158b6d >2013-12-09 04:30:27,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a89719a >2013-12-09 04:30:27,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a89719a >2013-12-09 04:30:32,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b71665e >2013-12-09 04:30:32,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5b71665e >2013-12-09 04:30:32,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6265dbcf >2013-12-09 04:30:33,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6265dbcf >2013-12-09 04:30:38,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7260d612 >2013-12-09 04:30:38,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7260d612 >2013-12-09 04:30:38,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56e94259 >2013-12-09 04:30:38,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56e94259 >2013-12-09 04:30:43,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 591afecf >2013-12-09 04:30:44,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 591afecf >2013-12-09 04:30:44,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ff26bd >2013-12-09 04:30:44,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ff26bd >2013-12-09 04:30:49,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 127fb087 >2013-12-09 04:30:50,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 127fb087 >2013-12-09 04:30:50,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ea83978 >2013-12-09 04:30:50,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ea83978 >2013-12-09 04:30:55,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6bef30cc >2013-12-09 04:30:56,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6bef30cc >2013-12-09 04:30:56,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f478ad1 >2013-12-09 04:30:56,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f478ad1 >2013-12-09 04:31:01,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d4b396d >2013-12-09 04:31:01,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d4b396d >2013-12-09 04:31:01,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 159be56d >2013-12-09 04:31:02,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 159be56d >2013-12-09 04:31:07,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c27c0b >2013-12-09 04:31:07,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c27c0b >2013-12-09 04:31:07,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7abc3c12 >2013-12-09 04:31:07,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7abc3c12 >2013-12-09 04:31:12,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36e473f >2013-12-09 04:31:13,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 36e473f >2013-12-09 04:31:13,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e4701da >2013-12-09 04:31:13,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e4701da >2013-12-09 04:31:14,079 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) No up server in cluster >2013-12-09 04:31:14,079 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:31:14,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2299aade >2013-12-09 04:31:14,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2299aade >2013-12-09 04:31:18,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c5b44b7 >2013-12-09 04:31:19,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6c5b44b7 >2013-12-09 04:31:19,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6eff0190 >2013-12-09 04:31:19,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6eff0190 >2013-12-09 04:31:24,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5afca37f >2013-12-09 04:31:24,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5afca37f >2013-12-09 04:31:24,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6bf29ff3 >2013-12-09 04:31:25,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6bf29ff3 >2013-12-09 04:31:30,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 610a2b14 >2013-12-09 04:31:30,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 610a2b14 >2013-12-09 04:31:30,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 183f115b >2013-12-09 04:31:30,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 183f115b >2013-12-09 04:31:35,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2dec68f9 >2013-12-09 04:31:36,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2dec68f9 >2013-12-09 04:31:36,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f491586 >2013-12-09 04:31:36,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f491586 >2013-12-09 04:31:41,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f5ba9c >2013-12-09 04:31:42,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f5ba9c >2013-12-09 04:31:42,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69665f6a >2013-12-09 04:31:42,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69665f6a >2013-12-09 04:31:47,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 60afcc52 >2013-12-09 04:31:48,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 60afcc52 >2013-12-09 04:31:48,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3aa363c9 >2013-12-09 04:31:48,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3aa363c9 >2013-12-09 04:31:53,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4dcaef48 >2013-12-09 04:31:53,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4dcaef48 >2013-12-09 04:31:53,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c9d71bd >2013-12-09 04:31:54,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c9d71bd >2013-12-09 04:31:59,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 80636b7 >2013-12-09 04:31:59,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 80636b7 >2013-12-09 04:31:59,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 28756024 >2013-12-09 04:31:59,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28756024 >2013-12-09 04:32:04,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74f1ee08 >2013-12-09 04:32:05,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 74f1ee08 >2013-12-09 04:32:05,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21201e38 >2013-12-09 04:32:05,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21201e38 >2013-12-09 04:32:10,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f2c010a >2013-12-09 04:32:11,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6f2c010a >2013-12-09 04:32:11,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5891d517 >2013-12-09 04:32:11,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5891d517 >2013-12-09 04:32:14,357 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-74) No up server in cluster >2013-12-09 04:32:14,357 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-74) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:32:14,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4756aceb >2013-12-09 04:32:14,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4756aceb >2013-12-09 04:32:16,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30739c3c >2013-12-09 04:32:16,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 30739c3c >2013-12-09 04:32:16,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8057c4e >2013-12-09 04:32:17,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8057c4e >2013-12-09 04:32:22,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74ac7a61 >2013-12-09 04:32:22,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 74ac7a61 >2013-12-09 04:32:22,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75241bde >2013-12-09 04:32:22,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75241bde >2013-12-09 04:32:27,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19b1a4f8 >2013-12-09 04:32:28,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 19b1a4f8 >2013-12-09 04:32:28,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: fe6926f >2013-12-09 04:32:28,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: fe6926f >2013-12-09 04:32:33,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69a72173 >2013-12-09 04:32:34,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 69a72173 >2013-12-09 04:32:34,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29379e60 >2013-12-09 04:32:34,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29379e60 >2013-12-09 04:32:39,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a5aba31 >2013-12-09 04:32:40,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4a5aba31 >2013-12-09 04:32:40,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c166495 >2013-12-09 04:32:40,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c166495 >2013-12-09 04:32:45,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b2e975a >2013-12-09 04:32:45,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b2e975a >2013-12-09 04:32:45,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c711363 >2013-12-09 04:32:46,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c711363 >2013-12-09 04:32:51,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 60fe2b80 >2013-12-09 04:32:51,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 60fe2b80 >2013-12-09 04:32:51,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26cf3b28 >2013-12-09 04:32:51,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26cf3b28 >2013-12-09 04:32:56,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 755a584 >2013-12-09 04:32:57,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 755a584 >2013-12-09 04:32:57,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76c3de8f >2013-12-09 04:32:57,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76c3de8f >2013-12-09 04:33:02,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43cd7736 >2013-12-09 04:33:03,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 43cd7736 >2013-12-09 04:33:03,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52a1999a >2013-12-09 04:33:03,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52a1999a >2013-12-09 04:33:08,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f9aea4d >2013-12-09 04:33:08,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f9aea4d >2013-12-09 04:33:08,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f203288 >2013-12-09 04:33:09,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f203288 >2013-12-09 04:33:14,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7aa07f22 >2013-12-09 04:33:14,642 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-73) No up server in cluster >2013-12-09 04:33:14,642 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-73) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:33:14,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f5fe42 >2013-12-09 04:33:14,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7aa07f22 >2013-12-09 04:33:14,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 113b77a >2013-12-09 04:33:14,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1f5fe42 >2013-12-09 04:33:15,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 113b77a >2013-12-09 04:33:20,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b18aa8c >2013-12-09 04:33:20,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b18aa8c >2013-12-09 04:33:20,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c7bfcd3 >2013-12-09 04:33:20,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c7bfcd3 >2013-12-09 04:33:25,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31c31262 >2013-12-09 04:33:26,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 31c31262 >2013-12-09 04:33:26,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f5a7034 >2013-12-09 04:33:26,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f5a7034 >2013-12-09 04:33:31,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ef15217 >2013-12-09 04:33:32,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: ef15217 >2013-12-09 04:33:32,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48c4e989 >2013-12-09 04:33:32,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48c4e989 >2013-12-09 04:33:37,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73bbc71e >2013-12-09 04:33:37,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 73bbc71e >2013-12-09 04:33:37,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20c2a881 >2013-12-09 04:33:38,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20c2a881 >2013-12-09 04:33:43,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3086a4a2 >2013-12-09 04:33:43,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3086a4a2 >2013-12-09 04:33:43,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 263567ed >2013-12-09 04:33:43,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 263567ed >2013-12-09 04:33:48,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20ee1260 >2013-12-09 04:33:49,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 20ee1260 >2013-12-09 04:33:49,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 242c8e18 >2013-12-09 04:33:49,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 242c8e18 >2013-12-09 04:33:54,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74609713 >2013-12-09 04:33:55,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 74609713 >2013-12-09 04:33:55,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 100d908b >2013-12-09 04:33:55,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 100d908b >2013-12-09 04:34:00,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46da02a >2013-12-09 04:34:01,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 46da02a >2013-12-09 04:34:01,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30856c24 >2013-12-09 04:34:01,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30856c24 >2013-12-09 04:34:06,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4961b807 >2013-12-09 04:34:06,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4961b807 >2013-12-09 04:34:06,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60cd2d7f >2013-12-09 04:34:07,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60cd2d7f >2013-12-09 04:34:12,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36dc9722 >2013-12-09 04:34:12,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 36dc9722 >2013-12-09 04:34:12,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45c55e35 >2013-12-09 04:34:12,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45c55e35 >2013-12-09 04:34:14,906 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-40) No up server in cluster >2013-12-09 04:34:14,906 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-40) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:34:14,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 147a0b73 >2013-12-09 04:34:15,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterTasksListVDSCommand, return: [], log id: 147a0b73 >2013-12-09 04:34:17,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f99f9d1 >2013-12-09 04:34:18,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6f99f9d1 >2013-12-09 04:34:18,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 126b8f26 >2013-12-09 04:34:18,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 126b8f26 >2013-12-09 04:34:23,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c5c79d >2013-12-09 04:34:24,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5c5c79d >2013-12-09 04:34:24,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5fe2c301 >2013-12-09 04:34:24,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fe2c301 >2013-12-09 04:34:29,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26329d8f >2013-12-09 04:34:29,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 26329d8f >2013-12-09 04:34:29,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 728b3aac >2013-12-09 04:34:30,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 728b3aac >2013-12-09 04:34:35,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 609592c2 >2013-12-09 04:34:35,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 609592c2 >2013-12-09 04:34:35,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6fd6fdad >2013-12-09 04:34:35,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6fd6fdad >2013-12-09 04:34:41,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44000645 >2013-12-09 04:34:41,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 44000645 >2013-12-09 04:34:41,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ade1ee6 >2013-12-09 04:34:41,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ade1ee6 >2013-12-09 04:34:46,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 675fead6 >2013-12-09 04:34:47,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 675fead6 >2013-12-09 04:34:47,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 633c9d0f >2013-12-09 04:34:47,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 633c9d0f >2013-12-09 04:34:52,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a47af85 >2013-12-09 04:34:52,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3a47af85 >2013-12-09 04:34:52,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20fb31fd >2013-12-09 04:34:53,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20fb31fd >2013-12-09 04:34:58,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 60315b78 >2013-12-09 04:34:58,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 60315b78 >2013-12-09 04:34:58,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f0f889a >2013-12-09 04:34:59,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f0f889a >2013-12-09 04:35:04,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4623eaef >2013-12-09 04:35:04,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4623eaef >2013-12-09 04:35:04,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 424aaae >2013-12-09 04:35:04,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 424aaae >2013-12-09 04:35:09,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 753246a0 >2013-12-09 04:35:10,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 753246a0 >2013-12-09 04:35:10,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69f8b97f >2013-12-09 04:35:10,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69f8b97f >2013-12-09 04:35:15,176 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-68) No up server in cluster >2013-12-09 04:35:15,176 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-68) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:35:15,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 288996aa >2013-12-09 04:35:15,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterTasksListVDSCommand, return: [], log id: 288996aa >2013-12-09 04:35:15,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f259e1d >2013-12-09 04:35:16,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f259e1d >2013-12-09 04:35:16,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 324067a7 >2013-12-09 04:35:16,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 324067a7 >2013-12-09 04:35:21,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18ec7175 >2013-12-09 04:35:21,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 18ec7175 >2013-12-09 04:35:21,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 511b79b1 >2013-12-09 04:35:22,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 511b79b1 >2013-12-09 04:35:27,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 906ce4c >2013-12-09 04:35:27,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 906ce4c >2013-12-09 04:35:27,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b5a1c03 >2013-12-09 04:35:27,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b5a1c03 >2013-12-09 04:35:32,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b0ed621 >2013-12-09 04:35:33,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b0ed621 >2013-12-09 04:35:33,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 336facd >2013-12-09 04:35:33,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 336facd >2013-12-09 04:35:38,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11f9444e >2013-12-09 04:35:39,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 11f9444e >2013-12-09 04:35:39,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61cf88f0 >2013-12-09 04:35:39,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61cf88f0 >2013-12-09 04:35:44,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f2c4422 >2013-12-09 04:35:44,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1f2c4422 >2013-12-09 04:35:44,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 224c1f55 >2013-12-09 04:35:45,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 224c1f55 >2013-12-09 04:35:50,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c079b9e >2013-12-09 04:35:50,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7c079b9e >2013-12-09 04:35:50,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3de471e >2013-12-09 04:35:51,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3de471e >2013-12-09 04:35:56,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 752ce802 >2013-12-09 04:35:56,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 752ce802 >2013-12-09 04:35:56,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6eefb5c5 >2013-12-09 04:35:56,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6eefb5c5 >2013-12-09 04:36:01,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: bcc9377 >2013-12-09 04:36:02,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: bcc9377 >2013-12-09 04:36:02,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13198666 >2013-12-09 04:36:02,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13198666 >2013-12-09 04:36:07,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61dc4bba >2013-12-09 04:36:08,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 61dc4bba >2013-12-09 04:36:08,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59b014ab >2013-12-09 04:36:08,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59b014ab >2013-12-09 04:36:13,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7062ee93 >2013-12-09 04:36:13,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7062ee93 >2013-12-09 04:36:13,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6db40a8c >2013-12-09 04:36:14,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6db40a8c >2013-12-09 04:36:15,467 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) No up server in cluster >2013-12-09 04:36:15,467 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:36:15,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 562c386 >2013-12-09 04:36:15,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterTasksListVDSCommand, return: [], log id: 562c386 >2013-12-09 04:36:19,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19d31a5c >2013-12-09 04:36:19,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 19d31a5c >2013-12-09 04:36:19,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ffbb785 >2013-12-09 04:36:19,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ffbb785 >2013-12-09 04:36:24,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72ed0f08 >2013-12-09 04:36:25,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 72ed0f08 >2013-12-09 04:36:25,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a1aa9b7 >2013-12-09 04:36:25,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a1aa9b7 >2013-12-09 04:36:30,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b7624c2 >2013-12-09 04:36:31,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b7624c2 >2013-12-09 04:36:31,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 792bc6de >2013-12-09 04:36:31,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 792bc6de >2013-12-09 04:36:36,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 524fc178 >2013-12-09 04:36:36,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 524fc178 >2013-12-09 04:36:36,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 22a3f531 >2013-12-09 04:36:37,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22a3f531 >2013-12-09 04:36:42,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7febdd48 >2013-12-09 04:36:42,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7febdd48 >2013-12-09 04:36:42,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b17e0e1 >2013-12-09 04:36:43,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b17e0e1 >2013-12-09 04:36:48,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37e27200 >2013-12-09 04:36:48,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 37e27200 >2013-12-09 04:36:48,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15206bff >2013-12-09 04:36:48,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15206bff >2013-12-09 04:36:53,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 254d42e8 >2013-12-09 04:36:54,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 254d42e8 >2013-12-09 04:36:54,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 44c6603a >2013-12-09 04:36:54,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44c6603a >2013-12-09 04:36:59,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 364a9b4b >2013-12-09 04:37:00,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 364a9b4b >2013-12-09 04:37:00,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: aa8cf59 >2013-12-09 04:37:00,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: aa8cf59 >2013-12-09 04:37:05,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 299d1693 >2013-12-09 04:37:05,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 299d1693 >2013-12-09 04:37:05,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6aab73de >2013-12-09 04:37:06,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6aab73de >2013-12-09 04:37:11,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 789eaae8 >2013-12-09 04:37:11,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 789eaae8 >2013-12-09 04:37:11,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c31a05 >2013-12-09 04:37:11,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c31a05 >2013-12-09 04:37:15,756 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-92) No up server in cluster >2013-12-09 04:37:15,756 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-92) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:37:15,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a8070e6 >2013-12-09 04:37:16,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4a8070e6 >2013-12-09 04:37:16,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2cccffec >2013-12-09 04:37:17,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2cccffec >2013-12-09 04:37:17,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7eb8a812 >2013-12-09 04:37:17,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7eb8a812 >2013-12-09 04:37:22,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f2d376d >2013-12-09 04:37:23,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f2d376d >2013-12-09 04:37:23,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d585d5f >2013-12-09 04:37:23,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d585d5f >2013-12-09 04:37:28,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16c9aa2e >2013-12-09 04:37:29,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 16c9aa2e >2013-12-09 04:37:29,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e159732 >2013-12-09 04:37:29,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e159732 >2013-12-09 04:37:34,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45605947 >2013-12-09 04:37:34,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 45605947 >2013-12-09 04:37:34,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5fdad8fe >2013-12-09 04:37:35,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fdad8fe >2013-12-09 04:37:40,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4def2a76 >2013-12-09 04:37:40,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4def2a76 >2013-12-09 04:37:40,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b99dd65 >2013-12-09 04:37:40,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b99dd65 >2013-12-09 04:37:45,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1bfc73fd >2013-12-09 04:37:46,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1bfc73fd >2013-12-09 04:37:46,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ffb6753 >2013-12-09 04:37:46,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ffb6753 >2013-12-09 04:37:51,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1693d00f >2013-12-09 04:37:52,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1693d00f >2013-12-09 04:37:52,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bbad158 >2013-12-09 04:37:52,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bbad158 >2013-12-09 04:37:57,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ef0e984 >2013-12-09 04:37:57,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5ef0e984 >2013-12-09 04:37:57,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2803865d >2013-12-09 04:37:58,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2803865d >2013-12-09 04:38:03,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13f77408 >2013-12-09 04:38:03,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 13f77408 >2013-12-09 04:38:03,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f07a9ff >2013-12-09 04:38:03,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f07a9ff >2013-12-09 04:38:08,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1745a2c5 >2013-12-09 04:38:09,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1745a2c5 >2013-12-09 04:38:09,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5719895 >2013-12-09 04:38:09,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5719895 >2013-12-09 04:38:14,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e92844b >2013-12-09 04:38:15,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e92844b >2013-12-09 04:38:15,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31945c74 >2013-12-09 04:38:15,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31945c74 >2013-12-09 04:38:16,039 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-60) No up server in cluster >2013-12-09 04:38:16,039 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-60) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:38:16,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1621b40d >2013-12-09 04:38:16,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1621b40d >2013-12-09 04:38:20,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61bf9913 >2013-12-09 04:38:20,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 61bf9913 >2013-12-09 04:38:20,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 258eb7cc >2013-12-09 04:38:21,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 258eb7cc >2013-12-09 04:38:26,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6fe65b6e >2013-12-09 04:38:26,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6fe65b6e >2013-12-09 04:38:26,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ec6c3fe >2013-12-09 04:38:26,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ec6c3fe >2013-12-09 04:38:31,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ad44af5 >2013-12-09 04:38:32,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ad44af5 >2013-12-09 04:38:32,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21f71f5b >2013-12-09 04:38:32,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21f71f5b >2013-12-09 04:38:37,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f07daae >2013-12-09 04:38:38,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: f07daae >2013-12-09 04:38:38,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a7da596 >2013-12-09 04:38:38,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a7da596 >2013-12-09 04:38:43,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5cd995b2 >2013-12-09 04:38:44,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5cd995b2 >2013-12-09 04:38:44,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29a7b73b >2013-12-09 04:38:44,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29a7b73b >2013-12-09 04:38:49,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27e2b25c >2013-12-09 04:38:49,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 27e2b25c >2013-12-09 04:38:49,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3630f349 >2013-12-09 04:38:50,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3630f349 >2013-12-09 04:38:55,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62cc221b >2013-12-09 04:38:55,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 62cc221b >2013-12-09 04:38:55,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45f06fa4 >2013-12-09 04:38:55,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45f06fa4 >2013-12-09 04:39:00,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6747278b >2013-12-09 04:39:01,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6747278b >2013-12-09 04:39:01,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f998e35 >2013-12-09 04:39:01,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f998e35 >2013-12-09 04:39:06,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2036ac91 >2013-12-09 04:39:07,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2036ac91 >2013-12-09 04:39:07,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35910d88 >2013-12-09 04:39:07,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35910d88 >2013-12-09 04:39:12,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46bb5849 >2013-12-09 04:39:12,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 46bb5849 >2013-12-09 04:39:12,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 739b8072 >2013-12-09 04:39:13,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 739b8072 >2013-12-09 04:39:16,328 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-53) No up server in cluster >2013-12-09 04:39:16,328 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-53) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:39:16,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71f19c62 >2013-12-09 04:39:16,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterTasksListVDSCommand, return: [], log id: 71f19c62 >2013-12-09 04:39:18,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31fb4f2a >2013-12-09 04:39:18,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 31fb4f2a >2013-12-09 04:39:18,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 617326e6 >2013-12-09 04:39:18,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 617326e6 >2013-12-09 04:39:23,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43126f9f >2013-12-09 04:39:24,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 43126f9f >2013-12-09 04:39:24,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1fd72479 >2013-12-09 04:39:24,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1fd72479 >2013-12-09 04:39:29,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1255a56d >2013-12-09 04:39:30,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1255a56d >2013-12-09 04:39:30,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 104f93ee >2013-12-09 04:39:30,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 104f93ee >2013-12-09 04:39:35,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e0331d7 >2013-12-09 04:39:36,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: e0331d7 >2013-12-09 04:39:36,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10003534 >2013-12-09 04:39:36,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10003534 >2013-12-09 04:39:41,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25c5d881 >2013-12-09 04:39:41,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 25c5d881 >2013-12-09 04:39:41,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13582ea2 >2013-12-09 04:39:42,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13582ea2 >2013-12-09 04:39:47,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2dec38f8 >2013-12-09 04:39:47,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2dec38f8 >2013-12-09 04:39:47,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6994a689 >2013-12-09 04:39:47,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6994a689 >2013-12-09 04:39:52,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10495778 >2013-12-09 04:39:53,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 10495778 >2013-12-09 04:39:53,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b863ced >2013-12-09 04:39:53,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b863ced >2013-12-09 04:39:58,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67dcb41f >2013-12-09 04:39:59,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 67dcb41f >2013-12-09 04:39:59,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e22ef0c >2013-12-09 04:39:59,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e22ef0c >2013-12-09 04:40:04,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2cd137a9 >2013-12-09 04:40:05,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2cd137a9 >2013-12-09 04:40:05,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20f45125 >2013-12-09 04:40:05,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20f45125 >2013-12-09 04:40:10,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 207f3a66 >2013-12-09 04:40:10,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 207f3a66 >2013-12-09 04:40:10,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45be194a >2013-12-09 04:40:11,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45be194a >2013-12-09 04:40:16,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67fbb0ef >2013-12-09 04:40:16,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 67fbb0ef >2013-12-09 04:40:16,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8c5305b >2013-12-09 04:40:16,614 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-34) No up server in cluster >2013-12-09 04:40:16,614 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-34) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:40:16,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f958459 >2013-12-09 04:40:16,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8c5305b >2013-12-09 04:40:16,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6f958459 >2013-12-09 04:40:21,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a6448f7 >2013-12-09 04:40:22,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a6448f7 >2013-12-09 04:40:22,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a2f1968 >2013-12-09 04:40:22,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a2f1968 >2013-12-09 04:40:27,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2759f2df >2013-12-09 04:40:28,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2759f2df >2013-12-09 04:40:28,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9fa9a23 >2013-12-09 04:40:28,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9fa9a23 >2013-12-09 04:40:33,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3678ea67 >2013-12-09 04:40:33,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3678ea67 >2013-12-09 04:40:33,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ee53a8 >2013-12-09 04:40:34,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ee53a8 >2013-12-09 04:40:39,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f3c9976 >2013-12-09 04:40:39,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f3c9976 >2013-12-09 04:40:39,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 191dd5ca >2013-12-09 04:40:39,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 191dd5ca >2013-12-09 04:40:44,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26edce4a >2013-12-09 04:40:45,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 26edce4a >2013-12-09 04:40:45,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e8ae34c >2013-12-09 04:40:45,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e8ae34c >2013-12-09 04:40:50,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43715793 >2013-12-09 04:40:51,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 43715793 >2013-12-09 04:40:51,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3cab6e1e >2013-12-09 04:40:51,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3cab6e1e >2013-12-09 04:40:56,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 692f67c4 >2013-12-09 04:40:56,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 692f67c4 >2013-12-09 04:40:56,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58c220b2 >2013-12-09 04:40:57,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58c220b2 >2013-12-09 04:41:02,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64b9afae >2013-12-09 04:41:02,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 64b9afae >2013-12-09 04:41:02,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e3641f5 >2013-12-09 04:41:03,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e3641f5 >2013-12-09 04:41:08,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5073d3aa >2013-12-09 04:41:08,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5073d3aa >2013-12-09 04:41:08,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d76ee18 >2013-12-09 04:41:08,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d76ee18 >2013-12-09 04:41:13,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42fd424a >2013-12-09 04:41:14,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42fd424a >2013-12-09 04:41:14,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 373b62a0 >2013-12-09 04:41:14,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 373b62a0 >2013-12-09 04:41:16,889 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-24) No up server in cluster >2013-12-09 04:41:16,889 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-24) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:41:16,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ec91104 >2013-12-09 04:41:17,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4ec91104 >2013-12-09 04:41:19,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 138dbbd0 >2013-12-09 04:41:20,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 138dbbd0 >2013-12-09 04:41:20,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c17906c >2013-12-09 04:41:20,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c17906c >2013-12-09 04:41:25,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4dec408e >2013-12-09 04:41:25,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4dec408e >2013-12-09 04:41:25,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a13980f >2013-12-09 04:41:26,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a13980f >2013-12-09 04:41:31,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 274f4212 >2013-12-09 04:41:31,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 274f4212 >2013-12-09 04:41:31,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 662535b5 >2013-12-09 04:41:31,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 662535b5 >2013-12-09 04:41:36,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5634b294 >2013-12-09 04:41:37,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5634b294 >2013-12-09 04:41:37,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76cdf8cd >2013-12-09 04:41:37,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76cdf8cd >2013-12-09 04:41:42,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 566973ed >2013-12-09 04:41:43,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 566973ed >2013-12-09 04:41:43,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e6f6ac4 >2013-12-09 04:41:43,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e6f6ac4 >2013-12-09 04:41:48,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66fd5b7f >2013-12-09 04:41:49,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 66fd5b7f >2013-12-09 04:41:49,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5cb2511f >2013-12-09 04:41:49,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cb2511f >2013-12-09 04:41:54,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78a765ea >2013-12-09 04:41:54,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 78a765ea >2013-12-09 04:41:54,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 142e3f60 >2013-12-09 04:41:55,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 142e3f60 >2013-12-09 04:42:00,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38d9b436 >2013-12-09 04:42:00,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 38d9b436 >2013-12-09 04:42:00,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6895f92e >2013-12-09 04:42:00,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6895f92e >2013-12-09 04:42:05,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 543dba81 >2013-12-09 04:42:06,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 543dba81 >2013-12-09 04:42:06,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59bc700d >2013-12-09 04:42:06,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59bc700d >2013-12-09 04:42:11,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61513450 >2013-12-09 04:42:12,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 61513450 >2013-12-09 04:42:12,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46aa814a >2013-12-09 04:42:12,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46aa814a >2013-12-09 04:42:17,165 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-56) No up server in cluster >2013-12-09 04:42:17,165 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-56) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:42:17,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47068a09 >2013-12-09 04:42:17,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39ed48b0 >2013-12-09 04:42:17,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterTasksListVDSCommand, return: [], log id: 47068a09 >2013-12-09 04:42:17,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 39ed48b0 >2013-12-09 04:42:17,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f0c0be6 >2013-12-09 04:42:18,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f0c0be6 >2013-12-09 04:42:23,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b0e1526 >2013-12-09 04:42:23,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b0e1526 >2013-12-09 04:42:23,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 691bb81e >2013-12-09 04:42:23,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 691bb81e >2013-12-09 04:42:28,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49bf5d28 >2013-12-09 04:42:29,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 49bf5d28 >2013-12-09 04:42:29,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36920d4d >2013-12-09 04:42:29,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36920d4d >2013-12-09 04:42:34,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d5db610 >2013-12-09 04:42:35,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d5db610 >2013-12-09 04:42:35,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 758cc547 >2013-12-09 04:42:35,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 758cc547 >2013-12-09 04:42:40,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12b003b5 >2013-12-09 04:42:41,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 12b003b5 >2013-12-09 04:42:41,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 736b8708 >2013-12-09 04:42:41,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 736b8708 >2013-12-09 04:42:46,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 671e8361 >2013-12-09 04:42:46,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 671e8361 >2013-12-09 04:42:46,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1fc188e1 >2013-12-09 04:42:47,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1fc188e1 >2013-12-09 04:42:52,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67ed60f1 >2013-12-09 04:42:52,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 67ed60f1 >2013-12-09 04:42:52,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17a5ef05 >2013-12-09 04:42:52,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17a5ef05 >2013-12-09 04:42:57,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a3e7d44 >2013-12-09 04:42:58,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4a3e7d44 >2013-12-09 04:42:58,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42e0e526 >2013-12-09 04:42:58,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42e0e526 >2013-12-09 04:43:03,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9658c04 >2013-12-09 04:43:04,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 9658c04 >2013-12-09 04:43:04,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1139fcc >2013-12-09 04:43:04,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1139fcc >2013-12-09 04:43:09,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70a043a6 >2013-12-09 04:43:09,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 70a043a6 >2013-12-09 04:43:09,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ae040f2 >2013-12-09 04:43:10,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ae040f2 >2013-12-09 04:43:15,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42e8b3d6 >2013-12-09 04:43:15,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42e8b3d6 >2013-12-09 04:43:15,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c3ec0ba >2013-12-09 04:43:16,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c3ec0ba >2013-12-09 04:43:17,453 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-26) No up server in cluster >2013-12-09 04:43:17,453 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-26) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:43:17,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2cdb5290 >2013-12-09 04:43:17,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2cdb5290 >2013-12-09 04:43:21,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f026c12 >2013-12-09 04:43:21,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f026c12 >2013-12-09 04:43:21,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51d7c71b >2013-12-09 04:43:21,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51d7c71b >2013-12-09 04:43:26,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 333df42d >2013-12-09 04:43:27,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 333df42d >2013-12-09 04:43:27,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 369531b7 >2013-12-09 04:43:27,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 369531b7 >2013-12-09 04:43:32,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48f02588 >2013-12-09 04:43:33,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 48f02588 >2013-12-09 04:43:33,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 381e22f0 >2013-12-09 04:43:33,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 381e22f0 >2013-12-09 04:43:38,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 122102d6 >2013-12-09 04:43:38,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 122102d6 >2013-12-09 04:43:38,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54031de8 >2013-12-09 04:43:39,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54031de8 >2013-12-09 04:43:44,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 643a343f >2013-12-09 04:43:44,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 643a343f >2013-12-09 04:43:44,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d5d3d77 >2013-12-09 04:43:44,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d5d3d77 >2013-12-09 04:43:49,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58448e0f >2013-12-09 04:43:50,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 58448e0f >2013-12-09 04:43:50,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6bf3cd62 >2013-12-09 04:43:50,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6bf3cd62 >2013-12-09 04:43:55,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: aa51f09 >2013-12-09 04:43:56,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: aa51f09 >2013-12-09 04:43:56,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bfa701 >2013-12-09 04:43:56,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1bfa701 >2013-12-09 04:44:01,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61218497 >2013-12-09 04:44:02,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 61218497 >2013-12-09 04:44:02,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 289997be >2013-12-09 04:44:02,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 289997be >2013-12-09 04:44:07,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a0b7390 >2013-12-09 04:44:07,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a0b7390 >2013-12-09 04:44:07,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: faa0973 >2013-12-09 04:44:08,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: faa0973 >2013-12-09 04:44:13,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64735dbc >2013-12-09 04:44:13,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 64735dbc >2013-12-09 04:44:13,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 527e19e1 >2013-12-09 04:44:13,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 527e19e1 >2013-12-09 04:44:17,739 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-16) No up server in cluster >2013-12-09 04:44:17,739 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-16) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:44:17,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b5e9180 >2013-12-09 04:44:18,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3b5e9180 >2013-12-09 04:44:18,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79a98a7b >2013-12-09 04:44:19,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 79a98a7b >2013-12-09 04:44:19,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13ac170e >2013-12-09 04:44:19,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13ac170e >2013-12-09 04:44:24,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ef73051 >2013-12-09 04:44:25,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7ef73051 >2013-12-09 04:44:25,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1eab4c43 >2013-12-09 04:44:25,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1eab4c43 >2013-12-09 04:44:30,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 666d7c38 >2013-12-09 04:44:30,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 666d7c38 >2013-12-09 04:44:30,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c1103e2 >2013-12-09 04:44:31,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c1103e2 >2013-12-09 04:44:36,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ebf5cff >2013-12-09 04:44:36,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7ebf5cff >2013-12-09 04:44:36,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2fd7469a >2013-12-09 04:44:36,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2fd7469a >2013-12-09 04:44:41,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6fce8938 >2013-12-09 04:44:42,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6fce8938 >2013-12-09 04:44:42,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75b9a701 >2013-12-09 04:44:42,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75b9a701 >2013-12-09 04:44:47,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69ba2547 >2013-12-09 04:44:48,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 69ba2547 >2013-12-09 04:44:48,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31116844 >2013-12-09 04:44:48,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31116844 >2013-12-09 04:44:53,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f95588a >2013-12-09 04:44:54,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f95588a >2013-12-09 04:44:54,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e189bd8 >2013-12-09 04:44:54,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e189bd8 >2013-12-09 04:44:59,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 254b0a30 >2013-12-09 04:44:59,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 254b0a30 >2013-12-09 04:44:59,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79674bd2 >2013-12-09 04:45:00,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79674bd2 >2013-12-09 04:45:05,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 245d474 >2013-12-09 04:45:05,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 245d474 >2013-12-09 04:45:05,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68cce123 >2013-12-09 04:45:05,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68cce123 >2013-12-09 04:45:10,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c06a39f >2013-12-09 04:45:11,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c06a39f >2013-12-09 04:45:11,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38624b14 >2013-12-09 04:45:11,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38624b14 >2013-12-09 04:45:16,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f8e3c71 >2013-12-09 04:45:17,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f8e3c71 >2013-12-09 04:45:17,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72911e04 >2013-12-09 04:45:17,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72911e04 >2013-12-09 04:45:18,006 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-64) No up server in cluster >2013-12-09 04:45:18,006 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-64) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:45:18,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26ef2105 >2013-12-09 04:45:18,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterTasksListVDSCommand, return: [], log id: 26ef2105 >2013-12-09 04:45:22,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5dd1d6ad >2013-12-09 04:45:22,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5dd1d6ad >2013-12-09 04:45:22,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48fd93a0 >2013-12-09 04:45:23,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48fd93a0 >2013-12-09 04:45:28,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ef9c905 >2013-12-09 04:45:28,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ef9c905 >2013-12-09 04:45:28,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a33f728 >2013-12-09 04:45:28,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a33f728 >2013-12-09 04:45:34,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e988a4b >2013-12-09 04:45:34,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1e988a4b >2013-12-09 04:45:34,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27afc999 >2013-12-09 04:45:34,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27afc999 >2013-12-09 04:45:39,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2592c11b >2013-12-09 04:45:40,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2592c11b >2013-12-09 04:45:40,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d9315f0 >2013-12-09 04:45:40,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d9315f0 >2013-12-09 04:45:45,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 929aeb0 >2013-12-09 04:45:46,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 929aeb0 >2013-12-09 04:45:46,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ea11686 >2013-12-09 04:45:46,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ea11686 >2013-12-09 04:45:51,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69074881 >2013-12-09 04:45:51,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 69074881 >2013-12-09 04:45:51,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 222d12 >2013-12-09 04:45:52,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 222d12 >2013-12-09 04:45:57,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52c6a486 >2013-12-09 04:45:57,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 52c6a486 >2013-12-09 04:45:57,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d67aa59 >2013-12-09 04:45:57,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d67aa59 >2013-12-09 04:46:02,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b7bcc8 >2013-12-09 04:46:03,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b7bcc8 >2013-12-09 04:46:03,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a39f166 >2013-12-09 04:46:03,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a39f166 >2013-12-09 04:46:08,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d561552 >2013-12-09 04:46:09,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2d561552 >2013-12-09 04:46:09,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6645a7d4 >2013-12-09 04:46:09,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6645a7d4 >2013-12-09 04:46:14,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35597582 >2013-12-09 04:46:14,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 35597582 >2013-12-09 04:46:14,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58e3e7c2 >2013-12-09 04:46:15,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58e3e7c2 >2013-12-09 04:46:18,290 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-22) No up server in cluster >2013-12-09 04:46:18,290 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-22) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:46:18,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f9c1c3b >2013-12-09 04:46:18,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2f9c1c3b >2013-12-09 04:46:20,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25463f13 >2013-12-09 04:46:20,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 25463f13 >2013-12-09 04:46:20,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39ba1b10 >2013-12-09 04:46:20,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39ba1b10 >2013-12-09 04:46:25,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6df6d070 >2013-12-09 04:46:26,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6df6d070 >2013-12-09 04:46:26,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d06cf65 >2013-12-09 04:46:26,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d06cf65 >2013-12-09 04:46:31,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6806678e >2013-12-09 04:46:32,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6806678e >2013-12-09 04:46:32,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1dbe9db0 >2013-12-09 04:46:32,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1dbe9db0 >2013-12-09 04:46:37,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 733003a9 >2013-12-09 04:46:38,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 733003a9 >2013-12-09 04:46:38,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ca06708 >2013-12-09 04:46:38,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ca06708 >2013-12-09 04:46:43,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 461022e >2013-12-09 04:46:43,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 461022e >2013-12-09 04:46:43,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20c62c4d >2013-12-09 04:46:44,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20c62c4d >2013-12-09 04:46:49,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10a34ef5 >2013-12-09 04:46:49,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 10a34ef5 >2013-12-09 04:46:49,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15dbb8e5 >2013-12-09 04:46:49,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15dbb8e5 >2013-12-09 04:46:54,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45ac0f4f >2013-12-09 04:46:55,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 45ac0f4f >2013-12-09 04:46:55,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6db913c9 >2013-12-09 04:46:55,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6db913c9 >2013-12-09 04:47:00,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32646e6 >2013-12-09 04:47:01,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 32646e6 >2013-12-09 04:47:01,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a16eec2 >2013-12-09 04:47:01,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a16eec2 >2013-12-09 04:47:06,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ccef508 >2013-12-09 04:47:06,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: ccef508 >2013-12-09 04:47:06,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26bccb97 >2013-12-09 04:47:07,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26bccb97 >2013-12-09 04:47:12,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1eedaf63 >2013-12-09 04:47:12,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1eedaf63 >2013-12-09 04:47:12,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f1d436c >2013-12-09 04:47:12,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f1d436c >2013-12-09 04:47:18,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2267f659 >2013-12-09 04:47:18,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2267f659 >2013-12-09 04:47:18,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 494b3a27 >2013-12-09 04:47:18,574 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-49) No up server in cluster >2013-12-09 04:47:18,575 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-49) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:47:18,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 624d22c3 >2013-12-09 04:47:18,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 494b3a27 >2013-12-09 04:47:18,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterTasksListVDSCommand, return: [], log id: 624d22c3 >2013-12-09 04:47:23,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5095a4a8 >2013-12-09 04:47:24,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5095a4a8 >2013-12-09 04:47:24,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7287880c >2013-12-09 04:47:24,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7287880c >2013-12-09 04:47:29,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4aae0e47 >2013-12-09 04:47:30,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4aae0e47 >2013-12-09 04:47:30,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1adcea26 >2013-12-09 04:47:30,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1adcea26 >2013-12-09 04:47:35,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 313161a8 >2013-12-09 04:47:35,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 313161a8 >2013-12-09 04:47:35,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12c7e1c1 >2013-12-09 04:47:36,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12c7e1c1 >2013-12-09 04:47:41,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42b0c280 >2013-12-09 04:47:41,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 42b0c280 >2013-12-09 04:47:41,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a8a4a0a >2013-12-09 04:47:41,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a8a4a0a >2013-12-09 04:47:46,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 447b8fb9 >2013-12-09 04:47:47,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 447b8fb9 >2013-12-09 04:47:47,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c02dc62 >2013-12-09 04:47:47,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c02dc62 >2013-12-09 04:47:52,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2089342c >2013-12-09 04:47:53,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2089342c >2013-12-09 04:47:53,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6caea09f >2013-12-09 04:47:53,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6caea09f >2013-12-09 04:47:58,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c6b6652 >2013-12-09 04:47:59,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c6b6652 >2013-12-09 04:47:59,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ce8536d >2013-12-09 04:47:59,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ce8536d >2013-12-09 04:48:04,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fa36cbb >2013-12-09 04:48:04,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2fa36cbb >2013-12-09 04:48:04,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 232d9a52 >2013-12-09 04:48:05,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 232d9a52 >2013-12-09 04:48:10,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ad91c3c >2013-12-09 04:48:10,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ad91c3c >2013-12-09 04:48:10,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2810b01b >2013-12-09 04:48:10,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2810b01b >2013-12-09 04:48:15,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d12a171 >2013-12-09 04:48:16,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d12a171 >2013-12-09 04:48:16,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57101419 >2013-12-09 04:48:16,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57101419 >2013-12-09 04:48:18,839 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-99) No up server in cluster >2013-12-09 04:48:18,840 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-99) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:48:18,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f983862 >2013-12-09 04:48:19,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2f983862 >2013-12-09 04:48:21,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70e8ba2e >2013-12-09 04:48:22,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 70e8ba2e >2013-12-09 04:48:22,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29e9c2e7 >2013-12-09 04:48:22,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29e9c2e7 >2013-12-09 04:48:27,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31b939a1 >2013-12-09 04:48:27,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 31b939a1 >2013-12-09 04:48:27,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a3ac3fe >2013-12-09 04:48:28,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a3ac3fe >2013-12-09 04:48:33,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d3bf18 >2013-12-09 04:48:33,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4d3bf18 >2013-12-09 04:48:33,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a8fe556 >2013-12-09 04:48:33,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a8fe556 >2013-12-09 04:48:38,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ab0305b >2013-12-09 04:48:39,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5ab0305b >2013-12-09 04:48:39,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23cff91e >2013-12-09 04:48:39,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23cff91e >2013-12-09 04:48:44,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17094625 >2013-12-09 04:48:45,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 17094625 >2013-12-09 04:48:45,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b1ed0ff >2013-12-09 04:48:45,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b1ed0ff >2013-12-09 04:48:50,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f36df >2013-12-09 04:48:50,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f36df >2013-12-09 04:48:50,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7cda65e4 >2013-12-09 04:48:51,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7cda65e4 >2013-12-09 04:48:56,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 573f0efd >2013-12-09 04:48:56,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 573f0efd >2013-12-09 04:48:56,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40d3e1c2 >2013-12-09 04:48:57,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40d3e1c2 >2013-12-09 04:49:02,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2fc598e3 >2013-12-09 04:49:02,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2fc598e3 >2013-12-09 04:49:02,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3fd895c >2013-12-09 04:49:02,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3fd895c >2013-12-09 04:49:07,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f0c1240 >2013-12-09 04:49:08,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7f0c1240 >2013-12-09 04:49:08,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5eb4db4b >2013-12-09 04:49:08,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5eb4db4b >2013-12-09 04:49:13,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d71b58b >2013-12-09 04:49:14,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4d71b58b >2013-12-09 04:49:14,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a5c5c2b >2013-12-09 04:49:14,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a5c5c2b >2013-12-09 04:49:19,128 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-18) No up server in cluster >2013-12-09 04:49:19,128 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-18) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:49:19,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7750d47f >2013-12-09 04:49:19,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c074613 >2013-12-09 04:49:19,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7750d47f >2013-12-09 04:49:19,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c074613 >2013-12-09 04:49:19,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31d4931a >2013-12-09 04:49:20,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31d4931a >2013-12-09 04:49:25,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29803c62 >2013-12-09 04:49:25,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 29803c62 >2013-12-09 04:49:25,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6016174f >2013-12-09 04:49:25,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6016174f >2013-12-09 04:49:30,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59d70e4d >2013-12-09 04:49:31,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 59d70e4d >2013-12-09 04:49:31,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a358f04 >2013-12-09 04:49:31,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a358f04 >2013-12-09 04:49:36,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e42bf9a >2013-12-09 04:49:37,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e42bf9a >2013-12-09 04:49:37,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1602ddfd >2013-12-09 04:49:37,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1602ddfd >2013-12-09 04:49:42,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bbaa879 >2013-12-09 04:49:42,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4bbaa879 >2013-12-09 04:49:42,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 251322b9 >2013-12-09 04:49:43,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 251322b9 >2013-12-09 04:49:48,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38c3635e >2013-12-09 04:49:48,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 38c3635e >2013-12-09 04:49:48,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f98bde7 >2013-12-09 04:49:49,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f98bde7 >2013-12-09 04:49:54,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f45d7bd >2013-12-09 04:49:54,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6f45d7bd >2013-12-09 04:49:54,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7765ba5 >2013-12-09 04:49:54,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7765ba5 >2013-12-09 04:49:59,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: baad554 >2013-12-09 04:50:00,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: baad554 >2013-12-09 04:50:00,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46a85699 >2013-12-09 04:50:00,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46a85699 >2013-12-09 04:50:05,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75859bc1 >2013-12-09 04:50:06,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 75859bc1 >2013-12-09 04:50:06,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 475203ca >2013-12-09 04:50:06,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 475203ca >2013-12-09 04:50:11,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 424b79d2 >2013-12-09 04:50:11,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 424b79d2 >2013-12-09 04:50:11,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51a0a5a >2013-12-09 04:50:12,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51a0a5a >2013-12-09 04:50:17,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36555060 >2013-12-09 04:50:17,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 36555060 >2013-12-09 04:50:17,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f96cdc0 >2013-12-09 04:50:17,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f96cdc0 >2013-12-09 04:50:19,403 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-87) No up server in cluster >2013-12-09 04:50:19,404 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-87) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:50:19,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b7d8cf8 >2013-12-09 04:50:19,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2b7d8cf8 >2013-12-09 04:50:22,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13fba633 >2013-12-09 04:50:23,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 13fba633 >2013-12-09 04:50:23,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ae4200b >2013-12-09 04:50:23,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ae4200b >2013-12-09 04:50:28,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f2d94ac >2013-12-09 04:50:29,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f2d94ac >2013-12-09 04:50:29,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45513bf0 >2013-12-09 04:50:29,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45513bf0 >2013-12-09 04:50:34,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1fa5596d >2013-12-09 04:50:35,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1fa5596d >2013-12-09 04:50:35,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c89dfd7 >2013-12-09 04:50:35,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c89dfd7 >2013-12-09 04:50:40,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3307379b >2013-12-09 04:50:40,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3307379b >2013-12-09 04:50:40,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52083e47 >2013-12-09 04:50:41,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52083e47 >2013-12-09 04:50:46,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19f1ce4f >2013-12-09 04:50:46,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19f1ce4f >2013-12-09 04:50:46,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10d05640 >2013-12-09 04:50:46,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10d05640 >2013-12-09 04:50:51,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b9c56c8 >2013-12-09 04:50:52,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: b9c56c8 >2013-12-09 04:50:52,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a5b7389 >2013-12-09 04:50:52,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a5b7389 >2013-12-09 04:50:57,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3bd0112a >2013-12-09 04:50:58,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3bd0112a >2013-12-09 04:50:58,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28f42306 >2013-12-09 04:50:58,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28f42306 >2013-12-09 04:51:03,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4af8c78c >2013-12-09 04:51:03,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4af8c78c >2013-12-09 04:51:03,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1fb58fe5 >2013-12-09 04:51:04,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1fb58fe5 >2013-12-09 04:51:09,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5bb95749 >2013-12-09 04:51:09,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5bb95749 >2013-12-09 04:51:09,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b9c3ca8 >2013-12-09 04:51:09,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b9c3ca8 >2013-12-09 04:51:14,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2af51b76 >2013-12-09 04:51:15,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2af51b76 >2013-12-09 04:51:15,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59e60582 >2013-12-09 04:51:15,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59e60582 >2013-12-09 04:51:19,687 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) No up server in cluster >2013-12-09 04:51:19,688 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:51:19,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 506072bd >2013-12-09 04:51:19,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterTasksListVDSCommand, return: [], log id: 506072bd >2013-12-09 04:51:20,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7728b564 >2013-12-09 04:51:21,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7728b564 >2013-12-09 04:51:21,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5289d4f3 >2013-12-09 04:51:21,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5289d4f3 >2013-12-09 04:51:26,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 463f09e1 >2013-12-09 04:51:26,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 463f09e1 >2013-12-09 04:51:26,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6dcf26f7 >2013-12-09 04:51:27,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6dcf26f7 >2013-12-09 04:51:32,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5496b1c2 >2013-12-09 04:51:32,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5496b1c2 >2013-12-09 04:51:32,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5dbcc88a >2013-12-09 04:51:33,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5dbcc88a >2013-12-09 04:51:38,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 277a762b >2013-12-09 04:51:38,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 277a762b >2013-12-09 04:51:38,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f20a706 >2013-12-09 04:51:38,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f20a706 >2013-12-09 04:51:43,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 387783ef >2013-12-09 04:51:44,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 387783ef >2013-12-09 04:51:44,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ce5e292 >2013-12-09 04:51:44,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ce5e292 >2013-12-09 04:51:49,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57c0ea39 >2013-12-09 04:51:50,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 57c0ea39 >2013-12-09 04:51:50,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46392305 >2013-12-09 04:51:50,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46392305 >2013-12-09 04:51:55,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2703eab >2013-12-09 04:51:55,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2703eab >2013-12-09 04:51:55,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2190ff97 >2013-12-09 04:51:56,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2190ff97 >2013-12-09 04:52:01,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b34ae9f >2013-12-09 04:52:01,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b34ae9f >2013-12-09 04:52:01,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7eba5a31 >2013-12-09 04:52:01,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7eba5a31 >2013-12-09 04:52:06,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75bd0f13 >2013-12-09 04:52:07,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 75bd0f13 >2013-12-09 04:52:07,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 495276eb >2013-12-09 04:52:07,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 495276eb >2013-12-09 04:52:12,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bf2d1aa >2013-12-09 04:52:13,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2bf2d1aa >2013-12-09 04:52:13,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34bc7a5 >2013-12-09 04:52:13,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34bc7a5 >2013-12-09 04:52:18,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4744ae35 >2013-12-09 04:52:19,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4744ae35 >2013-12-09 04:52:19,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f2664b >2013-12-09 04:52:19,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f2664b >2013-12-09 04:52:19,975 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-24) No up server in cluster >2013-12-09 04:52:19,975 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-24) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:52:19,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a4b7c67 >2013-12-09 04:52:20,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2a4b7c67 >2013-12-09 04:52:24,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ad998e4 >2013-12-09 04:52:24,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2ad998e4 >2013-12-09 04:52:24,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ed7a1a >2013-12-09 04:52:25,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ed7a1a >2013-12-09 04:52:30,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 262e375c >2013-12-09 04:52:30,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 262e375c >2013-12-09 04:52:30,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79753a62 >2013-12-09 04:52:30,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79753a62 >2013-12-09 04:52:35,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d9604bd >2013-12-09 04:52:36,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d9604bd >2013-12-09 04:52:36,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41a4e0f0 >2013-12-09 04:52:36,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41a4e0f0 >2013-12-09 04:52:41,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 311fc561 >2013-12-09 04:52:42,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 311fc561 >2013-12-09 04:52:42,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7cb25e08 >2013-12-09 04:52:42,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7cb25e08 >2013-12-09 04:52:47,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61cc1de5 >2013-12-09 04:52:47,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 61cc1de5 >2013-12-09 04:52:47,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c56c6d4 >2013-12-09 04:52:48,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c56c6d4 >2013-12-09 04:52:53,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: dd7b0df >2013-12-09 04:52:53,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: dd7b0df >2013-12-09 04:52:53,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d6ff254 >2013-12-09 04:52:53,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d6ff254 >2013-12-09 04:52:58,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61146bbe >2013-12-09 04:52:59,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 61146bbe >2013-12-09 04:52:59,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3748c1be >2013-12-09 04:52:59,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3748c1be >2013-12-09 04:53:04,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d67cecb >2013-12-09 04:53:05,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d67cecb >2013-12-09 04:53:05,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27e59061 >2013-12-09 04:53:05,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27e59061 >2013-12-09 04:53:10,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4edacfdb >2013-12-09 04:53:11,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4edacfdb >2013-12-09 04:53:11,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 745c9c4d >2013-12-09 04:53:11,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 745c9c4d >2013-12-09 04:53:16,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1261e644 >2013-12-09 04:53:16,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1261e644 >2013-12-09 04:53:16,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3fc9e494 >2013-12-09 04:53:17,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3fc9e494 >2013-12-09 04:53:20,244 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-3) [6d1f044] No up server in cluster >2013-12-09 04:53:20,244 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-3) [6d1f044] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:53:20,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7df55c90 >2013-12-09 04:53:20,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterTasksListVDSCommand, return: [], log id: 7df55c90 >2013-12-09 04:53:22,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16267233 >2013-12-09 04:53:22,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 16267233 >2013-12-09 04:53:22,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35b94583 >2013-12-09 04:53:22,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35b94583 >2013-12-09 04:53:27,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a6f61f4 >2013-12-09 04:53:28,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a6f61f4 >2013-12-09 04:53:28,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11e917b7 >2013-12-09 04:53:28,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11e917b7 >2013-12-09 04:53:33,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f6eb7b4 >2013-12-09 04:53:34,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5f6eb7b4 >2013-12-09 04:53:34,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a88f047 >2013-12-09 04:53:34,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a88f047 >2013-12-09 04:53:39,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ae92e91 >2013-12-09 04:53:39,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5ae92e91 >2013-12-09 04:53:39,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: dba8cba >2013-12-09 04:53:40,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: dba8cba >2013-12-09 04:53:45,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ab78e53 >2013-12-09 04:53:45,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ab78e53 >2013-12-09 04:53:45,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f717ef9 >2013-12-09 04:53:45,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f717ef9 >2013-12-09 04:53:50,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37f486b6 >2013-12-09 04:53:51,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 37f486b6 >2013-12-09 04:53:51,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 418c6529 >2013-12-09 04:53:51,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 418c6529 >2013-12-09 04:53:56,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36ed5468 >2013-12-09 04:53:57,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 36ed5468 >2013-12-09 04:53:57,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58ab09ad >2013-12-09 04:53:57,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58ab09ad >2013-12-09 04:54:02,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7044e652 >2013-12-09 04:54:03,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7044e652 >2013-12-09 04:54:03,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43d7bf18 >2013-12-09 04:54:03,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43d7bf18 >2013-12-09 04:54:08,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b268da5 >2013-12-09 04:54:08,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b268da5 >2013-12-09 04:54:08,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 259334da >2013-12-09 04:54:09,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 259334da >2013-12-09 04:54:14,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3286a91d >2013-12-09 04:54:14,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3286a91d >2013-12-09 04:54:14,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4df3412d >2013-12-09 04:54:14,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4df3412d >2013-12-09 04:54:19,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27c3d485 >2013-12-09 04:54:20,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 27c3d485 >2013-12-09 04:54:20,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c5260ee >2013-12-09 04:54:20,530 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-78) No up server in cluster >2013-12-09 04:54:20,530 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-78) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:54:20,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2456b9fa >2013-12-09 04:54:20,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c5260ee >2013-12-09 04:54:20,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2456b9fa >2013-12-09 04:54:25,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32ca7e5f >2013-12-09 04:54:26,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 32ca7e5f >2013-12-09 04:54:26,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 430aee16 >2013-12-09 04:54:26,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 430aee16 >2013-12-09 04:54:31,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e7ddfb2 >2013-12-09 04:54:31,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e7ddfb2 >2013-12-09 04:54:31,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3162fe23 >2013-12-09 04:54:32,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3162fe23 >2013-12-09 04:54:37,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32afb2ca >2013-12-09 04:54:37,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 32afb2ca >2013-12-09 04:54:37,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 683192e2 >2013-12-09 04:54:38,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 683192e2 >2013-12-09 04:54:43,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c0adc59 >2013-12-09 04:54:43,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6c0adc59 >2013-12-09 04:54:43,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17b6352c >2013-12-09 04:54:43,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17b6352c >2013-12-09 04:54:48,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19ffba56 >2013-12-09 04:54:49,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19ffba56 >2013-12-09 04:54:49,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 423973a0 >2013-12-09 04:54:49,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 423973a0 >2013-12-09 04:54:54,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 426fd133 >2013-12-09 04:54:55,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 426fd133 >2013-12-09 04:54:55,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32abce54 >2013-12-09 04:54:55,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32abce54 >2013-12-09 04:55:00,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 767c1270 >2013-12-09 04:55:00,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 767c1270 >2013-12-09 04:55:00,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 621a77c7 >2013-12-09 04:55:01,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 621a77c7 >2013-12-09 04:55:06,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 105bf3fa >2013-12-09 04:55:06,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 105bf3fa >2013-12-09 04:55:06,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ceabd61 >2013-12-09 04:55:06,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ceabd61 >2013-12-09 04:55:12,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42889b17 >2013-12-09 04:55:12,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42889b17 >2013-12-09 04:55:12,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f6f435d >2013-12-09 04:55:12,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f6f435d >2013-12-09 04:55:17,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ef984f1 >2013-12-09 04:55:18,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2ef984f1 >2013-12-09 04:55:18,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78636ffc >2013-12-09 04:55:18,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78636ffc >2013-12-09 04:55:20,804 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-30) No up server in cluster >2013-12-09 04:55:20,804 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-30) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:55:20,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a8819fa >2013-12-09 04:55:21,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6a8819fa >2013-12-09 04:55:23,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 722fa8a >2013-12-09 04:55:24,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 722fa8a >2013-12-09 04:55:24,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e832d7c >2013-12-09 04:55:24,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e832d7c >2013-12-09 04:55:29,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4bc81ddf >2013-12-09 04:55:29,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4bc81ddf >2013-12-09 04:55:29,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 702dc202 >2013-12-09 04:55:30,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 702dc202 >2013-12-09 04:55:35,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c9ca90e >2013-12-09 04:55:35,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c9ca90e >2013-12-09 04:55:35,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 345167c7 >2013-12-09 04:55:35,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 345167c7 >2013-12-09 04:55:40,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56326154 >2013-12-09 04:55:41,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 56326154 >2013-12-09 04:55:41,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 665eaed5 >2013-12-09 04:55:41,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 665eaed5 >2013-12-09 04:55:46,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4eda8b7e >2013-12-09 04:55:47,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4eda8b7e >2013-12-09 04:55:47,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a56253e >2013-12-09 04:55:47,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a56253e >2013-12-09 04:55:52,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5826cf46 >2013-12-09 04:55:52,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5826cf46 >2013-12-09 04:55:52,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 386c24ef >2013-12-09 04:55:53,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 386c24ef >2013-12-09 04:55:58,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a57c8cc >2013-12-09 04:55:58,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2a57c8cc >2013-12-09 04:55:58,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 616ba3c3 >2013-12-09 04:55:58,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 616ba3c3 >2013-12-09 04:56:03,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 754219fe >2013-12-09 04:56:04,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 754219fe >2013-12-09 04:56:04,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 739b7e32 >2013-12-09 04:56:04,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 739b7e32 >2013-12-09 04:56:09,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ebbfefe >2013-12-09 04:56:10,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: ebbfefe >2013-12-09 04:56:10,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 590552d3 >2013-12-09 04:56:10,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 590552d3 >2013-12-09 04:56:15,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c90326 >2013-12-09 04:56:15,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: c90326 >2013-12-09 04:56:15,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f966cee >2013-12-09 04:56:16,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f966cee >2013-12-09 04:56:21,089 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) No up server in cluster >2013-12-09 04:56:21,089 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:56:21,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8140373 >2013-12-09 04:56:21,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52248dea >2013-12-09 04:56:21,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterTasksListVDSCommand, return: [], log id: 8140373 >2013-12-09 04:56:21,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 52248dea >2013-12-09 04:56:21,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 343c0ff4 >2013-12-09 04:56:21,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 343c0ff4 >2013-12-09 04:56:26,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 343a3cf8 >2013-12-09 04:56:27,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 343a3cf8 >2013-12-09 04:56:27,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ffaebff >2013-12-09 04:56:27,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ffaebff >2013-12-09 04:56:32,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3163552a >2013-12-09 04:56:33,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3163552a >2013-12-09 04:56:33,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32729a23 >2013-12-09 04:56:33,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32729a23 >2013-12-09 04:56:38,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 110b7988 >2013-12-09 04:56:39,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 110b7988 >2013-12-09 04:56:39,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7acc5b57 >2013-12-09 04:56:39,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7acc5b57 >2013-12-09 04:56:44,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3fd0a529 >2013-12-09 04:56:44,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3fd0a529 >2013-12-09 04:56:44,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30da16f8 >2013-12-09 04:56:45,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30da16f8 >2013-12-09 04:56:50,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 310ba8d9 >2013-12-09 04:56:50,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 310ba8d9 >2013-12-09 04:56:50,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2700dcd5 >2013-12-09 04:56:50,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2700dcd5 >2013-12-09 04:56:55,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 671b8561 >2013-12-09 04:56:56,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 671b8561 >2013-12-09 04:56:56,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46588670 >2013-12-09 04:56:56,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46588670 >2013-12-09 04:57:01,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50cf873b >2013-12-09 04:57:02,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 50cf873b >2013-12-09 04:57:02,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66dd1514 >2013-12-09 04:57:02,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66dd1514 >2013-12-09 04:57:07,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 159a0fb7 >2013-12-09 04:57:07,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 159a0fb7 >2013-12-09 04:57:07,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c545957 >2013-12-09 04:57:08,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c545957 >2013-12-09 04:57:13,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: abaf27d >2013-12-09 04:57:13,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: abaf27d >2013-12-09 04:57:13,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 232070ec >2013-12-09 04:57:13,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 232070ec >2013-12-09 04:57:18,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 440af105 >2013-12-09 04:57:19,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 440af105 >2013-12-09 04:57:19,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1cdbeee2 >2013-12-09 04:57:19,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1cdbeee2 >2013-12-09 04:57:21,364 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-69) No up server in cluster >2013-12-09 04:57:21,364 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-69) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:57:21,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71c600b0 >2013-12-09 04:57:21,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterTasksListVDSCommand, return: [], log id: 71c600b0 >2013-12-09 04:57:24,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ba419e5 >2013-12-09 04:57:25,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4ba419e5 >2013-12-09 04:57:25,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 212adac0 >2013-12-09 04:57:25,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 212adac0 >2013-12-09 04:57:30,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c1c15e3 >2013-12-09 04:57:31,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7c1c15e3 >2013-12-09 04:57:31,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a7719cf >2013-12-09 04:57:31,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a7719cf >2013-12-09 04:57:36,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d0c2d59 >2013-12-09 04:57:36,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d0c2d59 >2013-12-09 04:57:36,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38234e61 >2013-12-09 04:57:37,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38234e61 >2013-12-09 04:57:42,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 255ea2a0 >2013-12-09 04:57:42,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 255ea2a0 >2013-12-09 04:57:42,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41869b3f >2013-12-09 04:57:42,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41869b3f >2013-12-09 04:57:47,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5141cece >2013-12-09 04:57:48,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5141cece >2013-12-09 04:57:48,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2343bb1a >2013-12-09 04:57:48,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2343bb1a >2013-12-09 04:57:53,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e881867 >2013-12-09 04:57:54,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e881867 >2013-12-09 04:57:54,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ed69910 >2013-12-09 04:57:54,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ed69910 >2013-12-09 04:57:59,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 416f49c8 >2013-12-09 04:57:59,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 416f49c8 >2013-12-09 04:57:59,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64e9a089 >2013-12-09 04:58:00,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64e9a089 >2013-12-09 04:58:05,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a3e33d9 >2013-12-09 04:58:05,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2a3e33d9 >2013-12-09 04:58:05,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b04f196 >2013-12-09 04:58:06,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b04f196 >2013-12-09 04:58:11,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16dac0dc >2013-12-09 04:58:11,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 16dac0dc >2013-12-09 04:58:11,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c1ab646 >2013-12-09 04:58:11,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c1ab646 >2013-12-09 04:58:16,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 638144a3 >2013-12-09 04:58:17,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 638144a3 >2013-12-09 04:58:17,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d61dfcf >2013-12-09 04:58:17,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d61dfcf >2013-12-09 04:58:21,637 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-54) No up server in cluster >2013-12-09 04:58:21,637 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-54) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:58:21,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 659718db >2013-12-09 04:58:21,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterTasksListVDSCommand, return: [], log id: 659718db >2013-12-09 04:58:22,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78f260f3 >2013-12-09 04:58:23,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 78f260f3 >2013-12-09 04:58:23,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a309a48 >2013-12-09 04:58:23,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a309a48 >2013-12-09 04:58:28,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ded1865 >2013-12-09 04:58:28,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: ded1865 >2013-12-09 04:58:28,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56a2f4e >2013-12-09 04:58:29,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56a2f4e >2013-12-09 04:58:34,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30844e69 >2013-12-09 04:58:34,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 30844e69 >2013-12-09 04:58:34,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c401cfe >2013-12-09 04:58:34,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c401cfe >2013-12-09 04:58:39,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f433ff3 >2013-12-09 04:58:40,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: f433ff3 >2013-12-09 04:58:40,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 250280b5 >2013-12-09 04:58:40,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 250280b5 >2013-12-09 04:58:45,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 471116fc >2013-12-09 04:58:46,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 471116fc >2013-12-09 04:58:46,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61f423f3 >2013-12-09 04:58:46,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61f423f3 >2013-12-09 04:58:51,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e1e988b >2013-12-09 04:58:52,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2e1e988b >2013-12-09 04:58:52,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61fa1756 >2013-12-09 04:58:52,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61fa1756 >2013-12-09 04:58:57,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 693d9e1f >2013-12-09 04:58:57,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 693d9e1f >2013-12-09 04:58:57,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 353b2ed0 >2013-12-09 04:58:58,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 353b2ed0 >2013-12-09 04:59:03,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39acc8de >2013-12-09 04:59:03,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 39acc8de >2013-12-09 04:59:03,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 223c6cd6 >2013-12-09 04:59:03,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 223c6cd6 >2013-12-09 04:59:08,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59fed798 >2013-12-09 04:59:09,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59fed798 >2013-12-09 04:59:09,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 268376b2 >2013-12-09 04:59:09,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 268376b2 >2013-12-09 04:59:14,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42089f24 >2013-12-09 04:59:15,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42089f24 >2013-12-09 04:59:15,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6bdd0f0b >2013-12-09 04:59:15,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6bdd0f0b >2013-12-09 04:59:20,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4dc55de7 >2013-12-09 04:59:20,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4dc55de7 >2013-12-09 04:59:20,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b81ff45 >2013-12-09 04:59:21,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b81ff45 >2013-12-09 04:59:21,902 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-75) No up server in cluster >2013-12-09 04:59:21,902 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-75) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 04:59:21,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1eb38c5e >2013-12-09 04:59:22,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1eb38c5e >2013-12-09 04:59:26,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d6a12eb >2013-12-09 04:59:26,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: d6a12eb >2013-12-09 04:59:26,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19492aa1 >2013-12-09 04:59:26,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19492aa1 >2013-12-09 04:59:31,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a167f06 >2013-12-09 04:59:32,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a167f06 >2013-12-09 04:59:32,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2eb5a7d3 >2013-12-09 04:59:32,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2eb5a7d3 >2013-12-09 04:59:37,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a2906fd >2013-12-09 04:59:38,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6a2906fd >2013-12-09 04:59:38,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12637c39 >2013-12-09 04:59:38,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12637c39 >2013-12-09 04:59:38,728 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-28) Attempting to update VMs/Templates Ovf. >2013-12-09 04:59:40,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-49) START, GlusterHooksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e25d553 >2013-12-09 04:59:40,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-47) START, GlusterHooksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6dc1cbb8 >2013-12-09 04:59:40,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-47) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@bbff6fc5, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@3f4391a4, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@23829f33, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@819c3523, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@7a3a4470, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@7cb6bb85, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@adaaa0c0], log id: 6dc1cbb8 >2013-12-09 04:59:40,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-49) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@b72f34fd, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@d7203cc1, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@1613d34f, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@4ab429c5, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@15e26161, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@4107fdfc, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@ffd52450], log id: 4e25d553 >2013-12-09 04:59:43,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3359ebe3 >2013-12-09 04:59:44,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3359ebe3 >2013-12-09 04:59:44,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 358159b0 >2013-12-09 04:59:44,312 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-50) Start refreshing all users data >2013-12-09 04:59:44,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 358159b0 >2013-12-09 04:59:49,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ac48a6f >2013-12-09 04:59:49,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5ac48a6f >2013-12-09 04:59:49,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 401dc5fb >2013-12-09 04:59:50,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 401dc5fb >2013-12-09 04:59:55,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a789899 >2013-12-09 04:59:55,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2a789899 >2013-12-09 04:59:55,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6069c448 >2013-12-09 04:59:55,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6069c448 >2013-12-09 05:00:00,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1dfb75cc >2013-12-09 05:00:01,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1dfb75cc >2013-12-09 05:00:01,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6fd2ce28 >2013-12-09 05:00:01,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6fd2ce28 >2013-12-09 05:00:06,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5585af1f >2013-12-09 05:00:07,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5585af1f >2013-12-09 05:00:07,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38be074a >2013-12-09 05:00:07,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38be074a >2013-12-09 05:00:12,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2181363f >2013-12-09 05:00:12,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2181363f >2013-12-09 05:00:12,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41635c0f >2013-12-09 05:00:13,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41635c0f >2013-12-09 05:00:18,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 508024f9 >2013-12-09 05:00:18,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 508024f9 >2013-12-09 05:00:18,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70e14c28 >2013-12-09 05:00:18,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70e14c28 >2013-12-09 05:00:22,180 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-72) No up server in cluster >2013-12-09 05:00:22,180 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-72) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:00:22,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39a39e40 >2013-12-09 05:00:22,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterTasksListVDSCommand, return: [], log id: 39a39e40 >2013-12-09 05:00:23,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37e09cc4 >2013-12-09 05:00:24,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 37e09cc4 >2013-12-09 05:00:24,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ecca25c >2013-12-09 05:00:24,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ecca25c >2013-12-09 05:00:29,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7722d4db >2013-12-09 05:00:30,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7722d4db >2013-12-09 05:00:30,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79747c64 >2013-12-09 05:00:30,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79747c64 >2013-12-09 05:00:35,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1cd4bea6 >2013-12-09 05:00:36,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1cd4bea6 >2013-12-09 05:00:36,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6642aab8 >2013-12-09 05:00:36,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6642aab8 >2013-12-09 05:00:41,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f6d084 >2013-12-09 05:00:41,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7f6d084 >2013-12-09 05:00:41,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3880720e >2013-12-09 05:00:42,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3880720e >2013-12-09 05:00:47,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53c8f49a >2013-12-09 05:00:47,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 53c8f49a >2013-12-09 05:00:47,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40c0f081 >2013-12-09 05:00:47,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40c0f081 >2013-12-09 05:00:52,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6cf4b082 >2013-12-09 05:00:53,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6cf4b082 >2013-12-09 05:00:53,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55d1e862 >2013-12-09 05:00:53,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55d1e862 >2013-12-09 05:00:58,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 510d4db7 >2013-12-09 05:00:59,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 510d4db7 >2013-12-09 05:00:59,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11b926e >2013-12-09 05:00:59,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11b926e >2013-12-09 05:01:04,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 299621ec >2013-12-09 05:01:04,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 299621ec >2013-12-09 05:01:04,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70bec146 >2013-12-09 05:01:05,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70bec146 >2013-12-09 05:01:10,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 744babd3 >2013-12-09 05:01:10,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 744babd3 >2013-12-09 05:01:10,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e515912 >2013-12-09 05:01:10,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e515912 >2013-12-09 05:01:16,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8eda6bb >2013-12-09 05:01:16,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 8eda6bb >2013-12-09 05:01:16,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f0aa04d >2013-12-09 05:01:16,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f0aa04d >2013-12-09 05:01:21,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b29339 >2013-12-09 05:01:22,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b29339 >2013-12-09 05:01:22,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e1d5ddf >2013-12-09 05:01:22,464 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-66) No up server in cluster >2013-12-09 05:01:22,464 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-66) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:01:22,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11b23b64 >2013-12-09 05:01:22,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e1d5ddf >2013-12-09 05:01:22,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterTasksListVDSCommand, return: [], log id: 11b23b64 >2013-12-09 05:01:27,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 419fadfc >2013-12-09 05:01:28,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 419fadfc >2013-12-09 05:01:28,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f514970 >2013-12-09 05:01:28,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f514970 >2013-12-09 05:01:33,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72bc9526 >2013-12-09 05:01:33,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 72bc9526 >2013-12-09 05:01:33,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16a3cc92 >2013-12-09 05:01:34,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16a3cc92 >2013-12-09 05:01:39,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b51ef02 >2013-12-09 05:01:39,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b51ef02 >2013-12-09 05:01:39,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 243219b3 >2013-12-09 05:01:39,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 243219b3 >2013-12-09 05:01:44,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61ff3929 >2013-12-09 05:01:45,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 61ff3929 >2013-12-09 05:01:45,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f85aec5 >2013-12-09 05:01:45,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f85aec5 >2013-12-09 05:01:50,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d259c0 >2013-12-09 05:01:51,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d259c0 >2013-12-09 05:01:51,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d473bc6 >2013-12-09 05:01:51,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d473bc6 >2013-12-09 05:01:56,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49df22e3 >2013-12-09 05:01:56,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 49df22e3 >2013-12-09 05:01:56,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62f5be19 >2013-12-09 05:01:57,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62f5be19 >2013-12-09 05:02:02,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34288be3 >2013-12-09 05:02:02,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 34288be3 >2013-12-09 05:02:02,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d22a61b >2013-12-09 05:02:02,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d22a61b >2013-12-09 05:02:08,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20411dcf >2013-12-09 05:02:08,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 20411dcf >2013-12-09 05:02:08,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1dab22c2 >2013-12-09 05:02:08,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1dab22c2 >2013-12-09 05:02:13,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 110fd1a0 >2013-12-09 05:02:14,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 110fd1a0 >2013-12-09 05:02:14,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b7b1eda >2013-12-09 05:02:14,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b7b1eda >2013-12-09 05:02:19,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10f7a3b7 >2013-12-09 05:02:20,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 10f7a3b7 >2013-12-09 05:02:20,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b23121a >2013-12-09 05:02:20,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b23121a >2013-12-09 05:02:22,726 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-79) No up server in cluster >2013-12-09 05:02:22,726 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-79) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:02:22,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66dd9125 >2013-12-09 05:02:22,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterTasksListVDSCommand, return: [], log id: 66dd9125 >2013-12-09 05:02:25,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 283de9b7 >2013-12-09 05:02:25,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 283de9b7 >2013-12-09 05:02:25,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21f4801 >2013-12-09 05:02:26,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21f4801 >2013-12-09 05:02:31,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c2ba7c5 >2013-12-09 05:02:31,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c2ba7c5 >2013-12-09 05:02:31,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ad3c5be >2013-12-09 05:02:31,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ad3c5be >2013-12-09 05:02:36,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c127c58 >2013-12-09 05:02:37,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c127c58 >2013-12-09 05:02:37,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1fd8f1ed >2013-12-09 05:02:37,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1fd8f1ed >2013-12-09 05:02:42,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7277f31e >2013-12-09 05:02:43,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7277f31e >2013-12-09 05:02:43,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21cac530 >2013-12-09 05:02:43,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21cac530 >2013-12-09 05:02:48,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70ade451 >2013-12-09 05:02:48,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 70ade451 >2013-12-09 05:02:48,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7014fd36 >2013-12-09 05:02:49,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7014fd36 >2013-12-09 05:02:54,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 120071e3 >2013-12-09 05:02:54,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 120071e3 >2013-12-09 05:02:54,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 25baba25 >2013-12-09 05:02:55,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25baba25 >2013-12-09 05:03:00,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67e87ef3 >2013-12-09 05:03:00,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 67e87ef3 >2013-12-09 05:03:00,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 506840ff >2013-12-09 05:03:00,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 506840ff >2013-12-09 05:03:05,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39a12a12 >2013-12-09 05:03:06,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 39a12a12 >2013-12-09 05:03:06,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29ae62c >2013-12-09 05:03:06,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29ae62c >2013-12-09 05:03:11,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34683d3b >2013-12-09 05:03:12,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 34683d3b >2013-12-09 05:03:12,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c1766fd >2013-12-09 05:03:12,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c1766fd >2013-12-09 05:03:17,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d27509c >2013-12-09 05:03:17,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6d27509c >2013-12-09 05:03:17,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c19e8 >2013-12-09 05:03:18,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c19e8 >2013-12-09 05:03:22,993 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-22) No up server in cluster >2013-12-09 05:03:22,994 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-22) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:03:22,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19283c7f >2013-12-09 05:03:23,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70386728 >2013-12-09 05:03:23,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterTasksListVDSCommand, return: [], log id: 19283c7f >2013-12-09 05:03:23,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 70386728 >2013-12-09 05:03:23,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ce1888b >2013-12-09 05:03:23,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ce1888b >2013-12-09 05:03:28,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50947758 >2013-12-09 05:03:29,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 50947758 >2013-12-09 05:03:29,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36368d5a >2013-12-09 05:03:29,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36368d5a >2013-12-09 05:03:34,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 610145c7 >2013-12-09 05:03:35,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 610145c7 >2013-12-09 05:03:35,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41a0949e >2013-12-09 05:03:35,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41a0949e >2013-12-09 05:03:40,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1777f6dd >2013-12-09 05:03:41,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1777f6dd >2013-12-09 05:03:41,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65744e78 >2013-12-09 05:03:41,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65744e78 >2013-12-09 05:03:46,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5fb341f3 >2013-12-09 05:03:46,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5fb341f3 >2013-12-09 05:03:46,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53782f9d >2013-12-09 05:03:47,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53782f9d >2013-12-09 05:03:52,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45184382 >2013-12-09 05:03:52,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 45184382 >2013-12-09 05:03:52,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17376e46 >2013-12-09 05:03:52,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17376e46 >2013-12-09 05:03:57,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 102683c >2013-12-09 05:03:58,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 102683c >2013-12-09 05:03:58,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 737ba57c >2013-12-09 05:03:58,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 737ba57c >2013-12-09 05:04:03,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e352ada >2013-12-09 05:04:04,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e352ada >2013-12-09 05:04:04,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e4a9914 >2013-12-09 05:04:04,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e4a9914 >2013-12-09 05:04:09,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1523a842 >2013-12-09 05:04:09,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1523a842 >2013-12-09 05:04:09,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 247cae37 >2013-12-09 05:04:10,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 247cae37 >2013-12-09 05:04:15,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b2c9963 >2013-12-09 05:04:15,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b2c9963 >2013-12-09 05:04:15,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 328be887 >2013-12-09 05:04:15,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 328be887 >2013-12-09 05:04:20,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31ea6dc6 >2013-12-09 05:04:21,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 31ea6dc6 >2013-12-09 05:04:21,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e5462bf >2013-12-09 05:04:21,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e5462bf >2013-12-09 05:04:23,281 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-12) No up server in cluster >2013-12-09 05:04:23,281 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-12) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:04:23,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43c935ba >2013-12-09 05:04:23,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterTasksListVDSCommand, return: [], log id: 43c935ba >2013-12-09 05:04:26,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 691958a4 >2013-12-09 05:04:27,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 691958a4 >2013-12-09 05:04:27,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 694e75be >2013-12-09 05:04:27,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 694e75be >2013-12-09 05:04:32,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f936f05 >2013-12-09 05:04:33,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1f936f05 >2013-12-09 05:04:33,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ccbffad >2013-12-09 05:04:33,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ccbffad >2013-12-09 05:04:38,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75d4b84 >2013-12-09 05:04:38,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 75d4b84 >2013-12-09 05:04:38,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6faff2b0 >2013-12-09 05:04:39,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6faff2b0 >2013-12-09 05:04:44,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b294efe >2013-12-09 05:04:44,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b294efe >2013-12-09 05:04:44,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54acf0c0 >2013-12-09 05:04:44,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54acf0c0 >2013-12-09 05:04:49,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1198d27e >2013-12-09 05:04:50,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1198d27e >2013-12-09 05:04:50,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 296be7fc >2013-12-09 05:04:50,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 296be7fc >2013-12-09 05:04:55,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41a7dde1 >2013-12-09 05:04:56,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 41a7dde1 >2013-12-09 05:04:56,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5777723d >2013-12-09 05:04:56,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5777723d >2013-12-09 05:05:01,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3680202c >2013-12-09 05:05:01,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3680202c >2013-12-09 05:05:01,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4adf701 >2013-12-09 05:05:02,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4adf701 >2013-12-09 05:05:07,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4880db18 >2013-12-09 05:05:07,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4880db18 >2013-12-09 05:05:07,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2eb140a5 >2013-12-09 05:05:07,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2eb140a5 >2013-12-09 05:05:12,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21a2e8b3 >2013-12-09 05:05:13,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 21a2e8b3 >2013-12-09 05:05:13,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68f6b90f >2013-12-09 05:05:13,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68f6b90f >2013-12-09 05:05:18,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 718e592a >2013-12-09 05:05:19,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 718e592a >2013-12-09 05:05:19,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 704152ba >2013-12-09 05:05:19,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 704152ba >2013-12-09 05:05:23,555 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-95) No up server in cluster >2013-12-09 05:05:23,555 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-95) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:05:23,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71ad331c >2013-12-09 05:05:23,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterTasksListVDSCommand, return: [], log id: 71ad331c >2013-12-09 05:05:24,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 478801c5 >2013-12-09 05:05:25,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 478801c5 >2013-12-09 05:05:25,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bffb690 >2013-12-09 05:05:25,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1bffb690 >2013-12-09 05:05:30,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1de443fd >2013-12-09 05:05:30,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1de443fd >2013-12-09 05:05:30,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53bcebc6 >2013-12-09 05:05:31,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53bcebc6 >2013-12-09 05:05:36,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18490f8a >2013-12-09 05:05:36,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 18490f8a >2013-12-09 05:05:36,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: af922e8 >2013-12-09 05:05:36,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: af922e8 >2013-12-09 05:05:41,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5929880b >2013-12-09 05:05:42,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5929880b >2013-12-09 05:05:42,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f00f3ff >2013-12-09 05:05:42,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f00f3ff >2013-12-09 05:05:47,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78cd9114 >2013-12-09 05:05:48,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 78cd9114 >2013-12-09 05:05:48,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39d2db56 >2013-12-09 05:05:48,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39d2db56 >2013-12-09 05:05:53,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50fe1722 >2013-12-09 05:05:53,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 50fe1722 >2013-12-09 05:05:53,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40457f02 >2013-12-09 05:05:54,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40457f02 >2013-12-09 05:05:59,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d25ba6a >2013-12-09 05:05:59,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d25ba6a >2013-12-09 05:05:59,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28692682 >2013-12-09 05:05:59,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28692682 >2013-12-09 05:06:04,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b798e0e >2013-12-09 05:06:05,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: b798e0e >2013-12-09 05:06:05,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4cfd4190 >2013-12-09 05:06:05,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4cfd4190 >2013-12-09 05:06:10,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 787e7028 >2013-12-09 05:06:11,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 787e7028 >2013-12-09 05:06:11,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30bad48e >2013-12-09 05:06:11,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30bad48e >2013-12-09 05:06:16,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a52f50e >2013-12-09 05:06:17,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6a52f50e >2013-12-09 05:06:17,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b9bf6a5 >2013-12-09 05:06:17,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b9bf6a5 >2013-12-09 05:06:22,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73c2e7d4 >2013-12-09 05:06:22,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 73c2e7d4 >2013-12-09 05:06:22,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 594293e8 >2013-12-09 05:06:23,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 594293e8 >2013-12-09 05:06:23,845 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-45) No up server in cluster >2013-12-09 05:06:23,845 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-45) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:06:23,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17b4866d >2013-12-09 05:06:24,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterTasksListVDSCommand, return: [], log id: 17b4866d >2013-12-09 05:06:28,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2688e496 >2013-12-09 05:06:28,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2688e496 >2013-12-09 05:06:28,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33fd6911 >2013-12-09 05:06:28,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33fd6911 >2013-12-09 05:06:33,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bd2654c >2013-12-09 05:06:34,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1bd2654c >2013-12-09 05:06:34,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a8ee889 >2013-12-09 05:06:34,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a8ee889 >2013-12-09 05:06:39,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fc7eb73 >2013-12-09 05:06:40,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7fc7eb73 >2013-12-09 05:06:40,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50eb36ed >2013-12-09 05:06:40,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50eb36ed >2013-12-09 05:06:45,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 452546b2 >2013-12-09 05:06:45,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 452546b2 >2013-12-09 05:06:45,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29fa4d59 >2013-12-09 05:06:46,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29fa4d59 >2013-12-09 05:06:51,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59220952 >2013-12-09 05:06:51,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59220952 >2013-12-09 05:06:51,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 441fdc35 >2013-12-09 05:06:51,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 441fdc35 >2013-12-09 05:06:56,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3edafe59 >2013-12-09 05:06:57,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3edafe59 >2013-12-09 05:06:57,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e9c07ee >2013-12-09 05:06:57,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e9c07ee >2013-12-09 05:07:02,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f4188ae >2013-12-09 05:07:03,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5f4188ae >2013-12-09 05:07:03,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7759d092 >2013-12-09 05:07:03,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7759d092 >2013-12-09 05:07:08,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2feb7311 >2013-12-09 05:07:09,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2feb7311 >2013-12-09 05:07:09,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c5b646f >2013-12-09 05:07:09,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c5b646f >2013-12-09 05:07:14,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48352626 >2013-12-09 05:07:14,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 48352626 >2013-12-09 05:07:14,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16faf5df >2013-12-09 05:07:15,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16faf5df >2013-12-09 05:07:20,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d22f311 >2013-12-09 05:07:20,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: d22f311 >2013-12-09 05:07:20,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f5587ac >2013-12-09 05:07:20,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f5587ac >2013-12-09 05:07:24,117 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-90) No up server in cluster >2013-12-09 05:07:24,118 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-90) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:07:24,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28c72c3a >2013-12-09 05:07:24,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterTasksListVDSCommand, return: [], log id: 28c72c3a >2013-12-09 05:07:25,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 103904a2 >2013-12-09 05:07:26,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 103904a2 >2013-12-09 05:07:26,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40468914 >2013-12-09 05:07:26,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40468914 >2013-12-09 05:07:31,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b399582 >2013-12-09 05:07:32,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b399582 >2013-12-09 05:07:32,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f1d6f05 >2013-12-09 05:07:32,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f1d6f05 >2013-12-09 05:07:37,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14afec0c >2013-12-09 05:07:38,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 14afec0c >2013-12-09 05:07:38,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57a03f27 >2013-12-09 05:07:38,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57a03f27 >2013-12-09 05:07:43,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1aa6dc00 >2013-12-09 05:07:43,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1aa6dc00 >2013-12-09 05:07:43,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 679342bc >2013-12-09 05:07:44,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 679342bc >2013-12-09 05:07:49,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4dd404aa >2013-12-09 05:07:49,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4dd404aa >2013-12-09 05:07:49,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47ee5bc >2013-12-09 05:07:49,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47ee5bc >2013-12-09 05:07:54,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1451860c >2013-12-09 05:07:55,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1451860c >2013-12-09 05:07:55,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 694b555d >2013-12-09 05:07:55,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 694b555d >2013-12-09 05:08:00,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 117eeb47 >2013-12-09 05:08:01,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 117eeb47 >2013-12-09 05:08:01,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9b04a4b >2013-12-09 05:08:01,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9b04a4b >2013-12-09 05:08:06,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1eaccde1 >2013-12-09 05:08:06,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1eaccde1 >2013-12-09 05:08:06,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b34d189 >2013-12-09 05:08:07,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b34d189 >2013-12-09 05:08:12,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c7200a8 >2013-12-09 05:08:12,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c7200a8 >2013-12-09 05:08:12,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f91ee3c >2013-12-09 05:08:12,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f91ee3c >2013-12-09 05:08:17,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 686e7617 >2013-12-09 05:08:18,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 686e7617 >2013-12-09 05:08:18,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7cb7fe17 >2013-12-09 05:08:18,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7cb7fe17 >2013-12-09 05:08:23,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9ad9a13 >2013-12-09 05:08:24,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 9ad9a13 >2013-12-09 05:08:24,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 231024e4 >2013-12-09 05:08:24,410 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-35) No up server in cluster >2013-12-09 05:08:24,410 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-35) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:08:24,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c0d2b79 >2013-12-09 05:08:24,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 231024e4 >2013-12-09 05:08:24,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterTasksListVDSCommand, return: [], log id: c0d2b79 >2013-12-09 05:08:29,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4cbb8d83 >2013-12-09 05:08:30,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4cbb8d83 >2013-12-09 05:08:30,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f81571 >2013-12-09 05:08:30,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f81571 >2013-12-09 05:08:35,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b00804a >2013-12-09 05:08:35,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3b00804a >2013-12-09 05:08:35,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: db5d027 >2013-12-09 05:08:36,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: db5d027 >2013-12-09 05:08:41,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5825fe4e >2013-12-09 05:08:41,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5825fe4e >2013-12-09 05:08:41,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 583e1da1 >2013-12-09 05:08:41,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 583e1da1 >2013-12-09 05:08:46,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5bd7b624 >2013-12-09 05:08:47,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5bd7b624 >2013-12-09 05:08:47,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3fa293a1 >2013-12-09 05:08:47,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3fa293a1 >2013-12-09 05:08:52,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 729d748 >2013-12-09 05:08:53,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 729d748 >2013-12-09 05:08:53,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37c4f4a6 >2013-12-09 05:08:53,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37c4f4a6 >2013-12-09 05:08:58,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24232329 >2013-12-09 05:08:58,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 24232329 >2013-12-09 05:08:58,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 22293041 >2013-12-09 05:08:59,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22293041 >2013-12-09 05:09:04,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59d137be >2013-12-09 05:09:04,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 59d137be >2013-12-09 05:09:04,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2478550d >2013-12-09 05:09:04,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2478550d >2013-12-09 05:09:09,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 536c9a83 >2013-12-09 05:09:10,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 536c9a83 >2013-12-09 05:09:10,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78fa6300 >2013-12-09 05:09:10,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78fa6300 >2013-12-09 05:09:15,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59dea8dc >2013-12-09 05:09:16,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59dea8dc >2013-12-09 05:09:16,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 478c6376 >2013-12-09 05:09:16,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 478c6376 >2013-12-09 05:09:21,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c8e5a90 >2013-12-09 05:09:22,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c8e5a90 >2013-12-09 05:09:22,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2574bd78 >2013-12-09 05:09:22,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2574bd78 >2013-12-09 05:09:24,686 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-82) No up server in cluster >2013-12-09 05:09:24,686 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-82) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:09:24,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1569ed62 >2013-12-09 05:09:24,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1569ed62 >2013-12-09 05:09:27,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 417b218d >2013-12-09 05:09:27,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 417b218d >2013-12-09 05:09:27,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 323fd551 >2013-12-09 05:09:28,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 323fd551 >2013-12-09 05:09:33,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 637e23a1 >2013-12-09 05:09:33,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 637e23a1 >2013-12-09 05:09:33,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b8c6bab >2013-12-09 05:09:33,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b8c6bab >2013-12-09 05:09:38,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b9515da >2013-12-09 05:09:39,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b9515da >2013-12-09 05:09:39,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 115d54e8 >2013-12-09 05:09:39,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 115d54e8 >2013-12-09 05:09:44,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f3f180b >2013-12-09 05:09:45,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7f3f180b >2013-12-09 05:09:45,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d561cc7 >2013-12-09 05:09:45,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d561cc7 >2013-12-09 05:09:50,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7958b482 >2013-12-09 05:09:50,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7958b482 >2013-12-09 05:09:50,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 653448a6 >2013-12-09 05:09:51,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 653448a6 >2013-12-09 05:09:56,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 457ac868 >2013-12-09 05:09:56,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 457ac868 >2013-12-09 05:09:56,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38c11c1d >2013-12-09 05:09:56,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38c11c1d >2013-12-09 05:10:01,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c50188 >2013-12-09 05:10:02,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c50188 >2013-12-09 05:10:02,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56bb69f8 >2013-12-09 05:10:02,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56bb69f8 >2013-12-09 05:10:07,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40f7c5fc >2013-12-09 05:10:08,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 40f7c5fc >2013-12-09 05:10:08,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1fc81681 >2013-12-09 05:10:08,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1fc81681 >2013-12-09 05:10:13,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 500f159a >2013-12-09 05:10:14,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 500f159a >2013-12-09 05:10:14,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 85c836c >2013-12-09 05:10:14,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 85c836c >2013-12-09 05:10:19,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72726874 >2013-12-09 05:10:20,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 72726874 >2013-12-09 05:10:20,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77543e6e >2013-12-09 05:10:20,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77543e6e >2013-12-09 05:10:24,967 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-27) No up server in cluster >2013-12-09 05:10:24,968 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-27) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:10:24,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f51e406 >2013-12-09 05:10:25,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6f51e406 >2013-12-09 05:10:25,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 490fb58 >2013-12-09 05:10:25,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 490fb58 >2013-12-09 05:10:25,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 142d9d0d >2013-12-09 05:10:26,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 142d9d0d >2013-12-09 05:10:31,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7973bba >2013-12-09 05:10:31,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7973bba >2013-12-09 05:10:31,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7176b434 >2013-12-09 05:10:31,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7176b434 >2013-12-09 05:10:36,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b69423b >2013-12-09 05:10:37,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b69423b >2013-12-09 05:10:37,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4401fa88 >2013-12-09 05:10:37,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4401fa88 >2013-12-09 05:10:42,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5becf8ab >2013-12-09 05:10:43,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5becf8ab >2013-12-09 05:10:43,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: bb0c4cf >2013-12-09 05:10:43,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: bb0c4cf >2013-12-09 05:10:48,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68934657 >2013-12-09 05:10:49,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 68934657 >2013-12-09 05:10:49,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23e06fc6 >2013-12-09 05:10:49,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23e06fc6 >2013-12-09 05:10:54,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f69e63c >2013-12-09 05:10:54,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3f69e63c >2013-12-09 05:10:54,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5828e5e8 >2013-12-09 05:10:55,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5828e5e8 >2013-12-09 05:11:00,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d0c2765 >2013-12-09 05:11:00,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5d0c2765 >2013-12-09 05:11:00,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33f1f4b4 >2013-12-09 05:11:00,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33f1f4b4 >2013-12-09 05:11:05,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46daa93 >2013-12-09 05:11:06,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 46daa93 >2013-12-09 05:11:06,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b0ca7f7 >2013-12-09 05:11:06,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b0ca7f7 >2013-12-09 05:11:11,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b4fa9cb >2013-12-09 05:11:12,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b4fa9cb >2013-12-09 05:11:12,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1124cd70 >2013-12-09 05:11:12,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1124cd70 >2013-12-09 05:11:17,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42d402f3 >2013-12-09 05:11:17,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42d402f3 >2013-12-09 05:11:17,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f36bb8 >2013-12-09 05:11:18,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f36bb8 >2013-12-09 05:11:23,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1746164f >2013-12-09 05:11:23,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1746164f >2013-12-09 05:11:23,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17352648 >2013-12-09 05:11:23,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17352648 >2013-12-09 05:11:25,259 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-78) No up server in cluster >2013-12-09 05:11:25,259 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-78) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:11:25,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66ea1d26 >2013-12-09 05:11:25,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterTasksListVDSCommand, return: [], log id: 66ea1d26 >2013-12-09 05:11:28,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74098837 >2013-12-09 05:11:29,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 74098837 >2013-12-09 05:11:29,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4db0614b >2013-12-09 05:11:29,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4db0614b >2013-12-09 05:11:34,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 587a3e09 >2013-12-09 05:11:35,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 587a3e09 >2013-12-09 05:11:35,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53029ed4 >2013-12-09 05:11:35,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53029ed4 >2013-12-09 05:11:40,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 22f2f75f >2013-12-09 05:11:41,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 22f2f75f >2013-12-09 05:11:41,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35cf18d >2013-12-09 05:11:41,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35cf18d >2013-12-09 05:11:46,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 434ba9ae >2013-12-09 05:11:46,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 434ba9ae >2013-12-09 05:11:46,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b325e91 >2013-12-09 05:11:47,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b325e91 >2013-12-09 05:11:52,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 391719d0 >2013-12-09 05:11:52,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 391719d0 >2013-12-09 05:11:52,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76f6a513 >2013-12-09 05:11:52,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76f6a513 >2013-12-09 05:11:57,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 337d507c >2013-12-09 05:11:58,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 337d507c >2013-12-09 05:11:58,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5583a069 >2013-12-09 05:11:58,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5583a069 >2013-12-09 05:12:03,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e32b1e6 >2013-12-09 05:12:04,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7e32b1e6 >2013-12-09 05:12:04,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1753f0c4 >2013-12-09 05:12:04,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1753f0c4 >2013-12-09 05:12:09,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e99624a >2013-12-09 05:12:09,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2e99624a >2013-12-09 05:12:09,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72a207b9 >2013-12-09 05:12:10,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72a207b9 >2013-12-09 05:12:15,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 405c4926 >2013-12-09 05:12:15,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 405c4926 >2013-12-09 05:12:15,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f66dcd7 >2013-12-09 05:12:15,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f66dcd7 >2013-12-09 05:12:20,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34d09754 >2013-12-09 05:12:21,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 34d09754 >2013-12-09 05:12:21,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54486dfc >2013-12-09 05:12:21,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54486dfc >2013-12-09 05:12:25,535 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) No up server in cluster >2013-12-09 05:12:25,536 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:12:25,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: bb3e326 >2013-12-09 05:12:25,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterTasksListVDSCommand, return: [], log id: bb3e326 >2013-12-09 05:12:26,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b0771f0 >2013-12-09 05:12:27,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5b0771f0 >2013-12-09 05:12:27,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61da95b6 >2013-12-09 05:12:27,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61da95b6 >2013-12-09 05:12:32,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26e6028e >2013-12-09 05:12:32,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 26e6028e >2013-12-09 05:12:32,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 148cab18 >2013-12-09 05:12:33,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 148cab18 >2013-12-09 05:12:38,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e81a678 >2013-12-09 05:12:38,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e81a678 >2013-12-09 05:12:38,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 24b5de25 >2013-12-09 05:12:38,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24b5de25 >2013-12-09 05:12:43,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68317d94 >2013-12-09 05:12:44,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 68317d94 >2013-12-09 05:12:44,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 341c2d35 >2013-12-09 05:12:44,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 341c2d35 >2013-12-09 05:12:49,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e2013d0 >2013-12-09 05:12:50,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4e2013d0 >2013-12-09 05:12:50,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a3b23b5 >2013-12-09 05:12:50,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a3b23b5 >2013-12-09 05:12:55,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ee3bcbc >2013-12-09 05:12:56,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3ee3bcbc >2013-12-09 05:12:56,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ab03ea >2013-12-09 05:12:56,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ab03ea >2013-12-09 05:13:01,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17fcd609 >2013-12-09 05:13:01,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 17fcd609 >2013-12-09 05:13:01,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74858158 >2013-12-09 05:13:02,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74858158 >2013-12-09 05:13:07,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 568770f >2013-12-09 05:13:07,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 568770f >2013-12-09 05:13:07,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f2183a >2013-12-09 05:13:07,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f2183a >2013-12-09 05:13:12,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17871692 >2013-12-09 05:13:13,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 17871692 >2013-12-09 05:13:13,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1981cec5 >2013-12-09 05:13:13,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1981cec5 >2013-12-09 05:13:18,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 671bb18a >2013-12-09 05:13:19,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 671bb18a >2013-12-09 05:13:19,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b2a896c >2013-12-09 05:13:19,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b2a896c >2013-12-09 05:13:24,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e68f910 >2013-12-09 05:13:24,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2e68f910 >2013-12-09 05:13:24,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4318396b >2013-12-09 05:13:25,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4318396b >2013-12-09 05:13:25,817 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-53) No up server in cluster >2013-12-09 05:13:25,817 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-53) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:13:25,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f472980 >2013-12-09 05:13:26,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6f472980 >2013-12-09 05:13:30,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a988179 >2013-12-09 05:13:30,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3a988179 >2013-12-09 05:13:30,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 692db321 >2013-12-09 05:13:30,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 692db321 >2013-12-09 05:13:35,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56497672 >2013-12-09 05:13:36,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 56497672 >2013-12-09 05:13:36,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d9e5e4f >2013-12-09 05:13:36,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d9e5e4f >2013-12-09 05:13:41,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a2cb85a >2013-12-09 05:13:42,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a2cb85a >2013-12-09 05:13:42,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70b8e394 >2013-12-09 05:13:42,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70b8e394 >2013-12-09 05:13:47,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f628848 >2013-12-09 05:13:47,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f628848 >2013-12-09 05:13:47,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63858db0 >2013-12-09 05:13:48,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63858db0 >2013-12-09 05:13:53,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 689f4379 >2013-12-09 05:13:53,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 689f4379 >2013-12-09 05:13:53,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c9f490d >2013-12-09 05:13:53,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c9f490d >2013-12-09 05:13:59,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 476a018d >2013-12-09 05:13:59,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 476a018d >2013-12-09 05:13:59,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6efcbb12 >2013-12-09 05:13:59,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6efcbb12 >2013-12-09 05:14:04,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d7e7eb6 >2013-12-09 05:14:05,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: d7e7eb6 >2013-12-09 05:14:05,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c3bd911 >2013-12-09 05:14:05,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c3bd911 >2013-12-09 05:14:10,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b010db3 >2013-12-09 05:14:11,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5b010db3 >2013-12-09 05:14:11,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 344381fc >2013-12-09 05:14:11,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 344381fc >2013-12-09 05:14:16,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18589efe >2013-12-09 05:14:16,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 18589efe >2013-12-09 05:14:16,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e25e67d >2013-12-09 05:14:17,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e25e67d >2013-12-09 05:14:22,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42487576 >2013-12-09 05:14:22,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42487576 >2013-12-09 05:14:22,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 692d78c2 >2013-12-09 05:14:22,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 692d78c2 >2013-12-09 05:14:26,103 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-69) No up server in cluster >2013-12-09 05:14:26,103 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-69) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:14:26,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44e3eba5 >2013-12-09 05:14:26,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterTasksListVDSCommand, return: [], log id: 44e3eba5 >2013-12-09 05:14:27,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 494dddaf >2013-12-09 05:14:28,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 494dddaf >2013-12-09 05:14:28,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ba8527b >2013-12-09 05:14:28,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ba8527b >2013-12-09 05:14:33,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 193e13ec >2013-12-09 05:14:34,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 193e13ec >2013-12-09 05:14:34,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ec3bce4 >2013-12-09 05:14:34,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ec3bce4 >2013-12-09 05:14:39,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5042fbf >2013-12-09 05:14:40,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5042fbf >2013-12-09 05:14:40,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 770daa5e >2013-12-09 05:14:40,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 770daa5e >2013-12-09 05:14:45,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f84aa3c >2013-12-09 05:14:45,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3f84aa3c >2013-12-09 05:14:45,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 799b455f >2013-12-09 05:14:46,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 799b455f >2013-12-09 05:14:51,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5fe53631 >2013-12-09 05:14:51,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5fe53631 >2013-12-09 05:14:51,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70ae54d1 >2013-12-09 05:14:51,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70ae54d1 >2013-12-09 05:14:56,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 543f81bf >2013-12-09 05:14:57,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 543f81bf >2013-12-09 05:14:57,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b3c0146 >2013-12-09 05:14:57,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b3c0146 >2013-12-09 05:15:02,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77abab92 >2013-12-09 05:15:03,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 77abab92 >2013-12-09 05:15:03,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64b3d465 >2013-12-09 05:15:03,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64b3d465 >2013-12-09 05:15:08,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 429192ca >2013-12-09 05:15:08,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 429192ca >2013-12-09 05:15:08,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1601dcf4 >2013-12-09 05:15:09,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1601dcf4 >2013-12-09 05:15:14,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76df5459 >2013-12-09 05:15:14,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 76df5459 >2013-12-09 05:15:14,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 159db553 >2013-12-09 05:15:14,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 159db553 >2013-12-09 05:15:19,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e86d750 >2013-12-09 05:15:20,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7e86d750 >2013-12-09 05:15:20,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f6f8041 >2013-12-09 05:15:20,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f6f8041 >2013-12-09 05:15:25,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6be1f6a4 >2013-12-09 05:15:26,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6be1f6a4 >2013-12-09 05:15:26,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1cb80fc5 >2013-12-09 05:15:26,389 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-28) No up server in cluster >2013-12-09 05:15:26,389 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-28) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:15:26,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a32c8b0 >2013-12-09 05:15:26,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1cb80fc5 >2013-12-09 05:15:26,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterTasksListVDSCommand, return: [], log id: a32c8b0 >2013-12-09 05:15:31,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7198ebac >2013-12-09 05:15:31,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7198ebac >2013-12-09 05:15:31,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 141436cc >2013-12-09 05:15:32,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 141436cc >2013-12-09 05:15:37,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30ca80f9 >2013-12-09 05:15:37,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 30ca80f9 >2013-12-09 05:15:37,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 630b77e5 >2013-12-09 05:15:38,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 630b77e5 >2013-12-09 05:15:43,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a621a10 >2013-12-09 05:15:43,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: a621a10 >2013-12-09 05:15:43,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53de9915 >2013-12-09 05:15:43,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53de9915 >2013-12-09 05:15:48,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7fde928e >2013-12-09 05:15:49,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7fde928e >2013-12-09 05:15:49,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d00ad0a >2013-12-09 05:15:49,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d00ad0a >2013-12-09 05:15:54,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b971042 >2013-12-09 05:15:55,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b971042 >2013-12-09 05:15:55,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2949e771 >2013-12-09 05:15:55,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2949e771 >2013-12-09 05:16:00,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 274fea7e >2013-12-09 05:16:00,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 274fea7e >2013-12-09 05:16:00,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 22a2b9e >2013-12-09 05:16:01,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22a2b9e >2013-12-09 05:16:06,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e14ecc4 >2013-12-09 05:16:06,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1e14ecc4 >2013-12-09 05:16:06,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 304a76d2 >2013-12-09 05:16:07,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 304a76d2 >2013-12-09 05:16:12,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43328192 >2013-12-09 05:16:12,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 43328192 >2013-12-09 05:16:12,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e8e5058 >2013-12-09 05:16:12,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e8e5058 >2013-12-09 05:16:17,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3251389c >2013-12-09 05:16:18,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3251389c >2013-12-09 05:16:18,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e48734e >2013-12-09 05:16:18,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e48734e >2013-12-09 05:16:23,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5edfb95e >2013-12-09 05:16:24,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5edfb95e >2013-12-09 05:16:24,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ddcbb1c >2013-12-09 05:16:24,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ddcbb1c >2013-12-09 05:16:26,660 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-95) No up server in cluster >2013-12-09 05:16:26,660 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-95) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:16:26,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1460e69d >2013-12-09 05:16:26,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1460e69d >2013-12-09 05:16:29,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e3c4f06 >2013-12-09 05:16:29,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6e3c4f06 >2013-12-09 05:16:29,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a412f3f >2013-12-09 05:16:30,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a412f3f >2013-12-09 05:16:35,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bf40119 >2013-12-09 05:16:35,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1bf40119 >2013-12-09 05:16:35,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 258d631c >2013-12-09 05:16:35,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 258d631c >2013-12-09 05:16:40,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30fe502 >2013-12-09 05:16:41,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 30fe502 >2013-12-09 05:16:41,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51809cf9 >2013-12-09 05:16:41,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51809cf9 >2013-12-09 05:16:46,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b9c93a5 >2013-12-09 05:16:47,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b9c93a5 >2013-12-09 05:16:47,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: fc7fd39 >2013-12-09 05:16:47,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: fc7fd39 >2013-12-09 05:16:52,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1005647c >2013-12-09 05:16:52,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1005647c >2013-12-09 05:16:52,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ba462a8 >2013-12-09 05:16:53,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ba462a8 >2013-12-09 05:16:58,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7eeeb222 >2013-12-09 05:16:58,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7eeeb222 >2013-12-09 05:16:58,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79589f4 >2013-12-09 05:16:59,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79589f4 >2013-12-09 05:17:04,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10e2d5ae >2013-12-09 05:17:04,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 10e2d5ae >2013-12-09 05:17:04,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74d18330 >2013-12-09 05:17:04,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74d18330 >2013-12-09 05:17:09,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59101505 >2013-12-09 05:17:10,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 59101505 >2013-12-09 05:17:10,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 279d79a5 >2013-12-09 05:17:10,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 279d79a5 >2013-12-09 05:17:15,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38f53150 >2013-12-09 05:17:16,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 38f53150 >2013-12-09 05:17:16,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 730204f9 >2013-12-09 05:17:16,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 730204f9 >2013-12-09 05:17:21,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bbe4b07 >2013-12-09 05:17:21,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4bbe4b07 >2013-12-09 05:17:21,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33d32f32 >2013-12-09 05:17:22,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33d32f32 >2013-12-09 05:17:26,949 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-81) No up server in cluster >2013-12-09 05:17:26,949 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-81) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:17:26,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65259bae >2013-12-09 05:17:27,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 369bfd0d >2013-12-09 05:17:27,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterTasksListVDSCommand, return: [], log id: 65259bae >2013-12-09 05:17:27,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 369bfd0d >2013-12-09 05:17:27,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52332fea >2013-12-09 05:17:27,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52332fea >2013-12-09 05:17:32,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c9b2968 >2013-12-09 05:17:33,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7c9b2968 >2013-12-09 05:17:33,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a68ffc4 >2013-12-09 05:17:33,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a68ffc4 >2013-12-09 05:17:38,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e6446e9 >2013-12-09 05:17:39,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3e6446e9 >2013-12-09 05:17:39,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26616a25 >2013-12-09 05:17:39,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26616a25 >2013-12-09 05:17:44,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b86289c >2013-12-09 05:17:44,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b86289c >2013-12-09 05:17:44,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 609b2607 >2013-12-09 05:17:45,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 609b2607 >2013-12-09 05:17:50,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 24fe6bae >2013-12-09 05:17:50,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 24fe6bae >2013-12-09 05:17:50,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a410aaa >2013-12-09 05:17:51,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a410aaa >2013-12-09 05:17:56,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ae6fd25 >2013-12-09 05:17:56,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2ae6fd25 >2013-12-09 05:17:56,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 786161e3 >2013-12-09 05:17:56,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 786161e3 >2013-12-09 05:18:01,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c57697b >2013-12-09 05:18:02,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1c57697b >2013-12-09 05:18:02,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f589633 >2013-12-09 05:18:02,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f589633 >2013-12-09 05:18:07,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c4b9a46 >2013-12-09 05:18:08,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c4b9a46 >2013-12-09 05:18:08,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9658ad6 >2013-12-09 05:18:08,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9658ad6 >2013-12-09 05:18:13,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26552324 >2013-12-09 05:18:13,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 26552324 >2013-12-09 05:18:13,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44b6e832 >2013-12-09 05:18:14,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44b6e832 >2013-12-09 05:18:19,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 114bc9b2 >2013-12-09 05:18:19,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 114bc9b2 >2013-12-09 05:18:19,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 672511bc >2013-12-09 05:18:19,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 672511bc >2013-12-09 05:18:24,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1bb09dab >2013-12-09 05:18:25,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1bb09dab >2013-12-09 05:18:25,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f03c63c >2013-12-09 05:18:25,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f03c63c >2013-12-09 05:18:27,229 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-57) No up server in cluster >2013-12-09 05:18:27,229 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-57) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:18:27,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4262e5ac >2013-12-09 05:18:27,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4262e5ac >2013-12-09 05:18:30,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4afc6dd0 >2013-12-09 05:18:31,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4afc6dd0 >2013-12-09 05:18:31,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4efb0b99 >2013-12-09 05:18:31,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4efb0b99 >2013-12-09 05:18:36,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c8106cb >2013-12-09 05:18:37,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c8106cb >2013-12-09 05:18:37,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 610fd527 >2013-12-09 05:18:37,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 610fd527 >2013-12-09 05:18:42,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f5e99e5 >2013-12-09 05:18:42,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f5e99e5 >2013-12-09 05:18:42,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ba885e7 >2013-12-09 05:18:43,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ba885e7 >2013-12-09 05:18:48,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 744fb9de >2013-12-09 05:18:48,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 744fb9de >2013-12-09 05:18:48,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8f7da1c >2013-12-09 05:18:48,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8f7da1c >2013-12-09 05:18:53,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53b045f2 >2013-12-09 05:18:54,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 53b045f2 >2013-12-09 05:18:54,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58b9b4e0 >2013-12-09 05:18:54,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58b9b4e0 >2013-12-09 05:18:59,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e2f5322 >2013-12-09 05:19:00,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6e2f5322 >2013-12-09 05:19:00,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 564db3ce >2013-12-09 05:19:00,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 564db3ce >2013-12-09 05:19:05,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d39149e >2013-12-09 05:19:05,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d39149e >2013-12-09 05:19:05,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c1505f4 >2013-12-09 05:19:06,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c1505f4 >2013-12-09 05:19:11,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f052be9 >2013-12-09 05:19:12,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5f052be9 >2013-12-09 05:19:12,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: af32007 >2013-12-09 05:19:12,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: af32007 >2013-12-09 05:19:17,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a18e984 >2013-12-09 05:19:17,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7a18e984 >2013-12-09 05:19:17,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d2fa2fa >2013-12-09 05:19:18,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d2fa2fa >2013-12-09 05:19:23,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62a5c7d >2013-12-09 05:19:23,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 62a5c7d >2013-12-09 05:19:23,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65070e10 >2013-12-09 05:19:23,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65070e10 >2013-12-09 05:19:27,503 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) No up server in cluster >2013-12-09 05:19:27,503 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:19:27,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3fd18b4f >2013-12-09 05:19:27,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3fd18b4f >2013-12-09 05:19:28,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 649e9b20 >2013-12-09 05:19:29,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 649e9b20 >2013-12-09 05:19:29,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c4388be >2013-12-09 05:19:29,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c4388be >2013-12-09 05:19:34,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 178f926 >2013-12-09 05:19:35,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 178f926 >2013-12-09 05:19:35,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1cffe31b >2013-12-09 05:19:35,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1cffe31b >2013-12-09 05:19:40,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7491e1f5 >2013-12-09 05:19:40,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7491e1f5 >2013-12-09 05:19:40,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6851c997 >2013-12-09 05:19:41,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6851c997 >2013-12-09 05:19:46,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f020f33 >2013-12-09 05:19:46,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f020f33 >2013-12-09 05:19:46,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76085c4 >2013-12-09 05:19:46,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76085c4 >2013-12-09 05:19:51,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f78f84c >2013-12-09 05:19:52,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: f78f84c >2013-12-09 05:19:52,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e6a2935 >2013-12-09 05:19:52,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e6a2935 >2013-12-09 05:19:57,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3bcfa140 >2013-12-09 05:19:58,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3bcfa140 >2013-12-09 05:19:58,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e02c33 >2013-12-09 05:19:58,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e02c33 >2013-12-09 05:20:03,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1592492b >2013-12-09 05:20:04,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1592492b >2013-12-09 05:20:04,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1eead89a >2013-12-09 05:20:04,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1eead89a >2013-12-09 05:20:09,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d9f6435 >2013-12-09 05:20:09,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d9f6435 >2013-12-09 05:20:09,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 135073f7 >2013-12-09 05:20:10,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 135073f7 >2013-12-09 05:20:15,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2875d74f >2013-12-09 05:20:15,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2875d74f >2013-12-09 05:20:15,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d97c707 >2013-12-09 05:20:15,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d97c707 >2013-12-09 05:20:20,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b992af7 >2013-12-09 05:20:21,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b992af7 >2013-12-09 05:20:21,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ba0bf3 >2013-12-09 05:20:21,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ba0bf3 >2013-12-09 05:20:26,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ef6f647 >2013-12-09 05:20:27,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ef6f647 >2013-12-09 05:20:27,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 769a1260 >2013-12-09 05:20:27,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 769a1260 >2013-12-09 05:20:27,777 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-67) No up server in cluster >2013-12-09 05:20:27,777 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-67) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:20:27,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43827474 >2013-12-09 05:20:28,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterTasksListVDSCommand, return: [], log id: 43827474 >2013-12-09 05:20:32,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a4f027e >2013-12-09 05:20:32,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a4f027e >2013-12-09 05:20:32,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64eee47b >2013-12-09 05:20:33,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64eee47b >2013-12-09 05:20:38,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42214946 >2013-12-09 05:20:38,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 42214946 >2013-12-09 05:20:38,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52bca4ba >2013-12-09 05:20:38,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52bca4ba >2013-12-09 05:20:43,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f20b20f >2013-12-09 05:20:44,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: f20b20f >2013-12-09 05:20:44,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56981bbc >2013-12-09 05:20:44,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56981bbc >2013-12-09 05:20:49,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 102cd4cc >2013-12-09 05:20:50,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 102cd4cc >2013-12-09 05:20:50,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 469d992d >2013-12-09 05:20:50,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 469d992d >2013-12-09 05:20:55,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27136821 >2013-12-09 05:20:55,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 27136821 >2013-12-09 05:20:55,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f20f2e9 >2013-12-09 05:20:56,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f20f2e9 >2013-12-09 05:21:01,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69236370 >2013-12-09 05:21:01,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 69236370 >2013-12-09 05:21:01,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53384802 >2013-12-09 05:21:02,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53384802 >2013-12-09 05:21:07,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 287d0f65 >2013-12-09 05:21:07,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 287d0f65 >2013-12-09 05:21:07,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17675b49 >2013-12-09 05:21:07,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17675b49 >2013-12-09 05:21:12,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 518b1874 >2013-12-09 05:21:13,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 518b1874 >2013-12-09 05:21:13,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40133660 >2013-12-09 05:21:13,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40133660 >2013-12-09 05:21:18,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 187068b8 >2013-12-09 05:21:19,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 187068b8 >2013-12-09 05:21:19,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20258496 >2013-12-09 05:21:19,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20258496 >2013-12-09 05:21:24,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2507fde0 >2013-12-09 05:21:24,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2507fde0 >2013-12-09 05:21:24,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 297bbde2 >2013-12-09 05:21:25,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 297bbde2 >2013-12-09 05:21:28,060 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) No up server in cluster >2013-12-09 05:21:28,060 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:21:28,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54aae1be >2013-12-09 05:21:28,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterTasksListVDSCommand, return: [], log id: 54aae1be >2013-12-09 05:21:30,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1201c338 >2013-12-09 05:21:30,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1201c338 >2013-12-09 05:21:30,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a494e33 >2013-12-09 05:21:30,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a494e33 >2013-12-09 05:21:35,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 353d9a28 >2013-12-09 05:21:36,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 353d9a28 >2013-12-09 05:21:36,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f4cd802 >2013-12-09 05:21:36,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f4cd802 >2013-12-09 05:21:41,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 435200dd >2013-12-09 05:21:42,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 435200dd >2013-12-09 05:21:42,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f21dee9 >2013-12-09 05:21:42,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f21dee9 >2013-12-09 05:21:47,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31771bd7 >2013-12-09 05:21:48,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 31771bd7 >2013-12-09 05:21:48,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 323ad9d2 >2013-12-09 05:21:48,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 323ad9d2 >2013-12-09 05:21:53,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55db8b92 >2013-12-09 05:21:53,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 55db8b92 >2013-12-09 05:21:53,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58ff62d9 >2013-12-09 05:21:54,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58ff62d9 >2013-12-09 05:21:59,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d103909 >2013-12-09 05:21:59,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d103909 >2013-12-09 05:21:59,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52b39e7e >2013-12-09 05:21:59,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52b39e7e >2013-12-09 05:22:04,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d60781b >2013-12-09 05:22:05,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2d60781b >2013-12-09 05:22:05,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 509a60e8 >2013-12-09 05:22:05,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 509a60e8 >2013-12-09 05:22:10,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 525633ec >2013-12-09 05:22:11,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 525633ec >2013-12-09 05:22:11,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60e2f378 >2013-12-09 05:22:11,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60e2f378 >2013-12-09 05:22:16,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b540e4e >2013-12-09 05:22:16,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4b540e4e >2013-12-09 05:22:17,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29640693 >2013-12-09 05:22:17,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29640693 >2013-12-09 05:22:22,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67d13c6f >2013-12-09 05:22:22,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 67d13c6f >2013-12-09 05:22:22,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bd88adf >2013-12-09 05:22:23,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1bd88adf >2013-12-09 05:22:28,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65102916 >2013-12-09 05:22:28,343 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-46) No up server in cluster >2013-12-09 05:22:28,343 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-46) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:22:28,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44b2e271 >2013-12-09 05:22:28,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 65102916 >2013-12-09 05:22:28,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63b409c9 >2013-12-09 05:22:28,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterTasksListVDSCommand, return: [], log id: 44b2e271 >2013-12-09 05:22:28,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63b409c9 >2013-12-09 05:22:33,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 22cbdc4 >2013-12-09 05:22:34,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 22cbdc4 >2013-12-09 05:22:34,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ec8bd1b >2013-12-09 05:22:34,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ec8bd1b >2013-12-09 05:22:39,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34f079a0 >2013-12-09 05:22:40,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 34f079a0 >2013-12-09 05:22:40,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a367c16 >2013-12-09 05:22:40,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a367c16 >2013-12-09 05:22:45,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 581346d9 >2013-12-09 05:22:45,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 581346d9 >2013-12-09 05:22:45,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f3e7acb >2013-12-09 05:22:46,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f3e7acb >2013-12-09 05:22:51,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c59d416 >2013-12-09 05:22:51,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c59d416 >2013-12-09 05:22:51,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fe17a5f >2013-12-09 05:22:51,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fe17a5f >2013-12-09 05:22:56,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d11705e >2013-12-09 05:22:57,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d11705e >2013-12-09 05:22:57,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45837141 >2013-12-09 05:22:57,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45837141 >2013-12-09 05:23:02,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c78236 >2013-12-09 05:23:03,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c78236 >2013-12-09 05:23:03,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 492b550b >2013-12-09 05:23:03,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 492b550b >2013-12-09 05:23:08,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38f8bfb7 >2013-12-09 05:23:09,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 38f8bfb7 >2013-12-09 05:23:09,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26b0e07c >2013-12-09 05:23:09,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26b0e07c >2013-12-09 05:23:14,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ff2a5a >2013-12-09 05:23:14,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2ff2a5a >2013-12-09 05:23:14,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5dde3579 >2013-12-09 05:23:15,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5dde3579 >2013-12-09 05:23:20,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19d7720a >2013-12-09 05:23:20,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19d7720a >2013-12-09 05:23:20,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6972f06f >2013-12-09 05:23:20,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6972f06f >2013-12-09 05:23:25,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71fdd607 >2013-12-09 05:23:26,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 71fdd607 >2013-12-09 05:23:26,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72b6f4ba >2013-12-09 05:23:26,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72b6f4ba >2013-12-09 05:23:28,619 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-30) No up server in cluster >2013-12-09 05:23:28,619 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-30) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:23:28,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2699eae5 >2013-12-09 05:23:28,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2699eae5 >2013-12-09 05:23:31,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 173d8153 >2013-12-09 05:23:32,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 173d8153 >2013-12-09 05:23:32,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2641b37f >2013-12-09 05:23:32,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2641b37f >2013-12-09 05:23:37,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39ff790b >2013-12-09 05:23:37,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 39ff790b >2013-12-09 05:23:37,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4dfd681d >2013-12-09 05:23:38,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4dfd681d >2013-12-09 05:23:43,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 466f0ad1 >2013-12-09 05:23:43,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 466f0ad1 >2013-12-09 05:23:43,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 424b018f >2013-12-09 05:23:43,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 424b018f >2013-12-09 05:23:49,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: fffb96c >2013-12-09 05:23:49,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: fffb96c >2013-12-09 05:23:49,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5578d369 >2013-12-09 05:23:49,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5578d369 >2013-12-09 05:23:54,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71ac16f2 >2013-12-09 05:23:55,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 71ac16f2 >2013-12-09 05:23:55,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c66546e >2013-12-09 05:23:55,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c66546e >2013-12-09 05:24:00,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3344b803 >2013-12-09 05:24:01,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3344b803 >2013-12-09 05:24:01,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7562f9be >2013-12-09 05:24:01,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7562f9be >2013-12-09 05:24:06,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35b9a9e4 >2013-12-09 05:24:06,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 35b9a9e4 >2013-12-09 05:24:06,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3bf3c20f >2013-12-09 05:24:07,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3bf3c20f >2013-12-09 05:24:12,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29095ccb >2013-12-09 05:24:12,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 29095ccb >2013-12-09 05:24:12,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f7d9c9b >2013-12-09 05:24:12,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f7d9c9b >2013-12-09 05:24:17,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13f31056 >2013-12-09 05:24:18,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 13f31056 >2013-12-09 05:24:18,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 501acb26 >2013-12-09 05:24:18,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 501acb26 >2013-12-09 05:24:23,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d4f57ad >2013-12-09 05:24:24,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: d4f57ad >2013-12-09 05:24:24,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6080e4a6 >2013-12-09 05:24:24,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6080e4a6 >2013-12-09 05:24:28,895 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-11) No up server in cluster >2013-12-09 05:24:28,895 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-11) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:24:28,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30c9f48d >2013-12-09 05:24:29,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterTasksListVDSCommand, return: [], log id: 30c9f48d >2013-12-09 05:24:29,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ce2abca >2013-12-09 05:24:29,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2ce2abca >2013-12-09 05:24:29,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14f69cb8 >2013-12-09 05:24:30,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14f69cb8 >2013-12-09 05:24:35,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e46a572 >2013-12-09 05:24:35,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: e46a572 >2013-12-09 05:24:35,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e358418 >2013-12-09 05:24:35,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e358418 >2013-12-09 05:24:40,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d0a874b >2013-12-09 05:24:41,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6d0a874b >2013-12-09 05:24:41,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 653f607e >2013-12-09 05:24:41,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 653f607e >2013-12-09 05:24:46,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3091db55 >2013-12-09 05:24:47,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3091db55 >2013-12-09 05:24:47,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 596d0721 >2013-12-09 05:24:47,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 596d0721 >2013-12-09 05:24:52,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f1a67f4 >2013-12-09 05:24:53,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: f1a67f4 >2013-12-09 05:24:53,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6fefb60 >2013-12-09 05:24:53,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6fefb60 >2013-12-09 05:24:58,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d5add8 >2013-12-09 05:24:58,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d5add8 >2013-12-09 05:24:58,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d0ee879 >2013-12-09 05:24:59,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d0ee879 >2013-12-09 05:25:04,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54318d99 >2013-12-09 05:25:04,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 54318d99 >2013-12-09 05:25:04,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47087ffa >2013-12-09 05:25:04,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47087ffa >2013-12-09 05:25:09,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6cde2a6e >2013-12-09 05:25:10,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6cde2a6e >2013-12-09 05:25:10,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6db686d7 >2013-12-09 05:25:10,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6db686d7 >2013-12-09 05:25:15,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b9975d8 >2013-12-09 05:25:16,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5b9975d8 >2013-12-09 05:25:16,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2efddd3a >2013-12-09 05:25:16,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2efddd3a >2013-12-09 05:25:21,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e7ec724 >2013-12-09 05:25:21,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e7ec724 >2013-12-09 05:25:21,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ea16894 >2013-12-09 05:25:22,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ea16894 >2013-12-09 05:25:27,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 605bcdff >2013-12-09 05:25:27,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 605bcdff >2013-12-09 05:25:27,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76ba843a >2013-12-09 05:25:27,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76ba843a >2013-12-09 05:25:29,188 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-39) [63f3d095] No up server in cluster >2013-12-09 05:25:29,188 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-39) [63f3d095] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:25:29,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 294a6c2b >2013-12-09 05:25:29,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterTasksListVDSCommand, return: [], log id: 294a6c2b >2013-12-09 05:25:32,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35ff5c12 >2013-12-09 05:25:33,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 35ff5c12 >2013-12-09 05:25:33,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d1ca3b6 >2013-12-09 05:25:33,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d1ca3b6 >2013-12-09 05:25:38,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5af34703 >2013-12-09 05:25:39,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5af34703 >2013-12-09 05:25:39,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c9527d6 >2013-12-09 05:25:39,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c9527d6 >2013-12-09 05:25:44,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19bc9994 >2013-12-09 05:25:45,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 19bc9994 >2013-12-09 05:25:45,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76fed2cd >2013-12-09 05:25:45,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76fed2cd >2013-12-09 05:25:50,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b976cf2 >2013-12-09 05:25:50,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: b976cf2 >2013-12-09 05:25:50,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e1d2e7a >2013-12-09 05:25:51,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e1d2e7a >2013-12-09 05:25:56,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7106ee8e >2013-12-09 05:25:56,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7106ee8e >2013-12-09 05:25:56,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 596d3f2c >2013-12-09 05:25:56,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 596d3f2c >2013-12-09 05:26:01,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 485633b3 >2013-12-09 05:26:02,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 485633b3 >2013-12-09 05:26:02,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40e9d7d1 >2013-12-09 05:26:02,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40e9d7d1 >2013-12-09 05:26:07,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a0fe6f4 >2013-12-09 05:26:08,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3a0fe6f4 >2013-12-09 05:26:08,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4cf9766e >2013-12-09 05:26:08,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4cf9766e >2013-12-09 05:26:13,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 796c5319 >2013-12-09 05:26:13,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 796c5319 >2013-12-09 05:26:13,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 363aea6 >2013-12-09 05:26:14,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 363aea6 >2013-12-09 05:26:19,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 22948d9 >2013-12-09 05:26:19,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 22948d9 >2013-12-09 05:26:19,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40afd531 >2013-12-09 05:26:20,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40afd531 >2013-12-09 05:26:25,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7255f38e >2013-12-09 05:26:25,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7255f38e >2013-12-09 05:26:25,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f7ee41c >2013-12-09 05:26:25,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f7ee41c >2013-12-09 05:26:29,473 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-68) No up server in cluster >2013-12-09 05:26:29,473 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-68) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:26:29,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 536efe83 >2013-12-09 05:26:29,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterTasksListVDSCommand, return: [], log id: 536efe83 >2013-12-09 05:26:30,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e060b49 >2013-12-09 05:26:31,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2e060b49 >2013-12-09 05:26:31,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f67beb1 >2013-12-09 05:26:31,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f67beb1 >2013-12-09 05:26:36,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56d40851 >2013-12-09 05:26:37,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 56d40851 >2013-12-09 05:26:37,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f20dde5 >2013-12-09 05:26:37,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f20dde5 >2013-12-09 05:26:42,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 14ae7afa >2013-12-09 05:26:42,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 14ae7afa >2013-12-09 05:26:42,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e39bc6 >2013-12-09 05:26:43,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e39bc6 >2013-12-09 05:26:48,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a056756 >2013-12-09 05:26:48,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a056756 >2013-12-09 05:26:48,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27dbc237 >2013-12-09 05:26:48,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27dbc237 >2013-12-09 05:26:53,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 789a7678 >2013-12-09 05:26:54,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 789a7678 >2013-12-09 05:26:54,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ba6647f >2013-12-09 05:26:54,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ba6647f >2013-12-09 05:26:59,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10552a9f >2013-12-09 05:27:00,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 10552a9f >2013-12-09 05:27:00,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 468691e >2013-12-09 05:27:00,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 468691e >2013-12-09 05:27:05,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40758e76 >2013-12-09 05:27:05,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 40758e76 >2013-12-09 05:27:05,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 136d94b9 >2013-12-09 05:27:06,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 136d94b9 >2013-12-09 05:27:11,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 668da892 >2013-12-09 05:27:11,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 668da892 >2013-12-09 05:27:11,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4aa11794 >2013-12-09 05:27:11,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4aa11794 >2013-12-09 05:27:16,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c91b4b3 >2013-12-09 05:27:17,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5c91b4b3 >2013-12-09 05:27:17,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e5660cf >2013-12-09 05:27:17,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e5660cf >2013-12-09 05:27:22,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3bd46361 >2013-12-09 05:27:23,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3bd46361 >2013-12-09 05:27:23,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 497f86b3 >2013-12-09 05:27:23,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 497f86b3 >2013-12-09 05:27:28,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79fd3518 >2013-12-09 05:27:29,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 79fd3518 >2013-12-09 05:27:29,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 234b1cbe >2013-12-09 05:27:29,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 234b1cbe >2013-12-09 05:27:29,754 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-42) No up server in cluster >2013-12-09 05:27:29,754 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-42) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:27:29,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b4f6e5b >2013-12-09 05:27:30,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7b4f6e5b >2013-12-09 05:27:34,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d061d33 >2013-12-09 05:27:34,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d061d33 >2013-12-09 05:27:34,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1601755f >2013-12-09 05:27:35,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1601755f >2013-12-09 05:27:40,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bbd892c >2013-12-09 05:27:40,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2bbd892c >2013-12-09 05:27:40,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28269197 >2013-12-09 05:27:40,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28269197 >2013-12-09 05:27:45,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16a0bfd7 >2013-12-09 05:27:46,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 16a0bfd7 >2013-12-09 05:27:46,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 202fe829 >2013-12-09 05:27:46,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 202fe829 >2013-12-09 05:27:51,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 422bc065 >2013-12-09 05:27:52,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 422bc065 >2013-12-09 05:27:52,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b7e987 >2013-12-09 05:27:52,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b7e987 >2013-12-09 05:27:57,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41244af6 >2013-12-09 05:27:57,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 41244af6 >2013-12-09 05:27:57,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45919a5f >2013-12-09 05:27:58,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45919a5f >2013-12-09 05:28:03,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bfb1db7 >2013-12-09 05:28:03,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1bfb1db7 >2013-12-09 05:28:03,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b621c5a >2013-12-09 05:28:04,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b621c5a >2013-12-09 05:28:09,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 560b3e7a >2013-12-09 05:28:09,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 560b3e7a >2013-12-09 05:28:09,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 570f92c2 >2013-12-09 05:28:09,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 570f92c2 >2013-12-09 05:28:14,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 687e594a >2013-12-09 05:28:15,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 687e594a >2013-12-09 05:28:15,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62795faa >2013-12-09 05:28:15,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62795faa >2013-12-09 05:28:20,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e0b80ba >2013-12-09 05:28:21,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1e0b80ba >2013-12-09 05:28:21,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40b5d15e >2013-12-09 05:28:21,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40b5d15e >2013-12-09 05:28:26,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4172d8ad >2013-12-09 05:28:26,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4172d8ad >2013-12-09 05:28:26,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71ee82d2 >2013-12-09 05:28:27,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71ee82d2 >2013-12-09 05:28:30,029 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-26) No up server in cluster >2013-12-09 05:28:30,029 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-26) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:28:30,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1509c32e >2013-12-09 05:28:30,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1509c32e >2013-12-09 05:28:32,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a6167cd >2013-12-09 05:28:32,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1a6167cd >2013-12-09 05:28:32,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73f606a9 >2013-12-09 05:28:32,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73f606a9 >2013-12-09 05:28:37,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d884c >2013-12-09 05:28:38,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d884c >2013-12-09 05:28:38,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43b8bf87 >2013-12-09 05:28:38,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43b8bf87 >2013-12-09 05:28:43,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3781cfce >2013-12-09 05:28:44,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3781cfce >2013-12-09 05:28:44,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b783f2 >2013-12-09 05:28:44,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b783f2 >2013-12-09 05:28:49,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 589c033f >2013-12-09 05:28:49,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 589c033f >2013-12-09 05:28:49,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47288bd6 >2013-12-09 05:28:50,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47288bd6 >2013-12-09 05:28:55,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b42449b >2013-12-09 05:28:55,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5b42449b >2013-12-09 05:28:55,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51999a60 >2013-12-09 05:28:55,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51999a60 >2013-12-09 05:29:00,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33b3b5f0 >2013-12-09 05:29:01,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 33b3b5f0 >2013-12-09 05:29:01,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29f8cc53 >2013-12-09 05:29:01,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29f8cc53 >2013-12-09 05:29:06,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29d78485 >2013-12-09 05:29:07,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 29d78485 >2013-12-09 05:29:07,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5334eabe >2013-12-09 05:29:07,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5334eabe >2013-12-09 05:29:12,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4dd66a8b >2013-12-09 05:29:13,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4dd66a8b >2013-12-09 05:29:13,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69f54c32 >2013-12-09 05:29:13,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69f54c32 >2013-12-09 05:29:18,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4cc1cda5 >2013-12-09 05:29:18,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4cc1cda5 >2013-12-09 05:29:18,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 612b5e77 >2013-12-09 05:29:19,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 612b5e77 >2013-12-09 05:29:24,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b1521be >2013-12-09 05:29:24,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b1521be >2013-12-09 05:29:24,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55b54ec0 >2013-12-09 05:29:24,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55b54ec0 >2013-12-09 05:29:29,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 398b67d8 >2013-12-09 05:29:30,301 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-44) No up server in cluster >2013-12-09 05:29:30,301 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-44) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:29:30,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ed343bf >2013-12-09 05:29:30,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 398b67d8 >2013-12-09 05:29:30,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ec64526 >2013-12-09 05:29:30,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1ed343bf >2013-12-09 05:29:30,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ec64526 >2013-12-09 05:29:35,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6fba0ea2 >2013-12-09 05:29:36,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6fba0ea2 >2013-12-09 05:29:36,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19671279 >2013-12-09 05:29:36,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19671279 >2013-12-09 05:29:41,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10e81194 >2013-12-09 05:29:41,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 10e81194 >2013-12-09 05:29:41,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54b103c3 >2013-12-09 05:29:42,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54b103c3 >2013-12-09 05:29:47,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 599d2149 >2013-12-09 05:29:47,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 599d2149 >2013-12-09 05:29:47,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4cf9c2a2 >2013-12-09 05:29:48,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4cf9c2a2 >2013-12-09 05:29:53,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d70472c >2013-12-09 05:29:53,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5d70472c >2013-12-09 05:29:53,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4474e93d >2013-12-09 05:29:53,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4474e93d >2013-12-09 05:29:58,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3012494c >2013-12-09 05:29:59,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3012494c >2013-12-09 05:29:59,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3443d50c >2013-12-09 05:29:59,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3443d50c >2013-12-09 05:30:04,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 511e4349 >2013-12-09 05:30:05,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 511e4349 >2013-12-09 05:30:05,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34bd7503 >2013-12-09 05:30:05,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34bd7503 >2013-12-09 05:30:10,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a15d4e8 >2013-12-09 05:30:10,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6a15d4e8 >2013-12-09 05:30:10,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5face541 >2013-12-09 05:30:11,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5face541 >2013-12-09 05:30:16,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44c5dedd >2013-12-09 05:30:16,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 44c5dedd >2013-12-09 05:30:16,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7db9180 >2013-12-09 05:30:16,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7db9180 >2013-12-09 05:30:21,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a392109 >2013-12-09 05:30:22,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1a392109 >2013-12-09 05:30:22,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ba01396 >2013-12-09 05:30:22,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ba01396 >2013-12-09 05:30:27,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 767abd2b >2013-12-09 05:30:28,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 767abd2b >2013-12-09 05:30:28,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29297f0b >2013-12-09 05:30:28,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29297f0b >2013-12-09 05:30:30,575 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-40) No up server in cluster >2013-12-09 05:30:30,575 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-40) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:30:30,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a49313c >2013-12-09 05:30:30,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3a49313c >2013-12-09 05:30:33,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5adc5f39 >2013-12-09 05:30:33,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5adc5f39 >2013-12-09 05:30:33,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a36d614 >2013-12-09 05:30:34,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a36d614 >2013-12-09 05:30:39,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7bbe9c6d >2013-12-09 05:30:39,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7bbe9c6d >2013-12-09 05:30:39,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7294157e >2013-12-09 05:30:40,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7294157e >2013-12-09 05:30:45,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 660f0871 >2013-12-09 05:30:45,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 660f0871 >2013-12-09 05:30:45,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67e68fb6 >2013-12-09 05:30:45,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67e68fb6 >2013-12-09 05:30:50,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d8570 >2013-12-09 05:30:51,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6d8570 >2013-12-09 05:30:51,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 475bd2b9 >2013-12-09 05:30:51,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 475bd2b9 >2013-12-09 05:30:56,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ae74b6b >2013-12-09 05:30:57,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5ae74b6b >2013-12-09 05:30:57,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36609517 >2013-12-09 05:30:57,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36609517 >2013-12-09 05:31:02,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e598e0f >2013-12-09 05:31:02,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: e598e0f >2013-12-09 05:31:02,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f2d9bce >2013-12-09 05:31:03,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f2d9bce >2013-12-09 05:31:08,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3bbc60e6 >2013-12-09 05:31:08,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3bbc60e6 >2013-12-09 05:31:08,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b06998d >2013-12-09 05:31:08,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b06998d >2013-12-09 05:31:13,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6aaaf690 >2013-12-09 05:31:14,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6aaaf690 >2013-12-09 05:31:14,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 93a092c >2013-12-09 05:31:14,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 93a092c >2013-12-09 05:31:19,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3df9d767 >2013-12-09 05:31:20,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3df9d767 >2013-12-09 05:31:20,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 246d166e >2013-12-09 05:31:20,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 246d166e >2013-12-09 05:31:25,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19525cba >2013-12-09 05:31:26,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19525cba >2013-12-09 05:31:26,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c0bd087 >2013-12-09 05:31:26,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c0bd087 >2013-12-09 05:31:30,876 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-43) No up server in cluster >2013-12-09 05:31:30,876 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-43) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:31:30,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49a298b8 >2013-12-09 05:31:31,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterTasksListVDSCommand, return: [], log id: 49a298b8 >2013-12-09 05:31:31,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54c51f80 >2013-12-09 05:31:31,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 54c51f80 >2013-12-09 05:31:31,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11045c33 >2013-12-09 05:31:32,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11045c33 >2013-12-09 05:31:37,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f1774a2 >2013-12-09 05:31:37,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f1774a2 >2013-12-09 05:31:37,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b9a1baf >2013-12-09 05:31:37,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b9a1baf >2013-12-09 05:31:42,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 474dbfed >2013-12-09 05:31:43,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 474dbfed >2013-12-09 05:31:43,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: adc14bb >2013-12-09 05:31:43,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: adc14bb >2013-12-09 05:31:48,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 723e96f9 >2013-12-09 05:31:49,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 723e96f9 >2013-12-09 05:31:49,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a6033c4 >2013-12-09 05:31:49,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a6033c4 >2013-12-09 05:31:54,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39969735 >2013-12-09 05:31:54,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 39969735 >2013-12-09 05:31:54,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78acddc9 >2013-12-09 05:31:55,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78acddc9 >2013-12-09 05:32:00,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 339d75fa >2013-12-09 05:32:00,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 339d75fa >2013-12-09 05:32:00,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9adf60b >2013-12-09 05:32:01,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9adf60b >2013-12-09 05:32:06,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 632b270b >2013-12-09 05:32:06,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 632b270b >2013-12-09 05:32:06,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53bef812 >2013-12-09 05:32:06,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53bef812 >2013-12-09 05:32:11,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 438999ad >2013-12-09 05:32:12,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 438999ad >2013-12-09 05:32:12,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13be647a >2013-12-09 05:32:12,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13be647a >2013-12-09 05:32:17,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e393833 >2013-12-09 05:32:18,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e393833 >2013-12-09 05:32:18,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 49d4a211 >2013-12-09 05:32:18,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49d4a211 >2013-12-09 05:32:23,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48d14fde >2013-12-09 05:32:23,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 48d14fde >2013-12-09 05:32:23,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c7c64a7 >2013-12-09 05:32:24,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c7c64a7 >2013-12-09 05:32:29,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1791adc1 >2013-12-09 05:32:29,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1791adc1 >2013-12-09 05:32:29,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c3201a0 >2013-12-09 05:32:29,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c3201a0 >2013-12-09 05:32:31,159 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-25) No up server in cluster >2013-12-09 05:32:31,159 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-25) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:32:31,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71d4d220 >2013-12-09 05:32:31,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterTasksListVDSCommand, return: [], log id: 71d4d220 >2013-12-09 05:32:34,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6fb13f43 >2013-12-09 05:32:35,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6fb13f43 >2013-12-09 05:32:35,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 719efad1 >2013-12-09 05:32:35,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 719efad1 >2013-12-09 05:32:40,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58940fea >2013-12-09 05:32:41,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 58940fea >2013-12-09 05:32:41,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f7b98dc >2013-12-09 05:32:41,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f7b98dc >2013-12-09 05:32:46,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75958560 >2013-12-09 05:32:46,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 75958560 >2013-12-09 05:32:46,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33764b66 >2013-12-09 05:32:47,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33764b66 >2013-12-09 05:32:52,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 340c367e >2013-12-09 05:32:52,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 340c367e >2013-12-09 05:32:52,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 119b034 >2013-12-09 05:32:53,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 119b034 >2013-12-09 05:32:58,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 764d1c7b >2013-12-09 05:32:58,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 764d1c7b >2013-12-09 05:32:58,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65a40610 >2013-12-09 05:32:58,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65a40610 >2013-12-09 05:33:03,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5126d9f8 >2013-12-09 05:33:04,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5126d9f8 >2013-12-09 05:33:04,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76a42f2b >2013-12-09 05:33:04,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76a42f2b >2013-12-09 05:33:09,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1eedfdef >2013-12-09 05:33:10,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1eedfdef >2013-12-09 05:33:10,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 689200ee >2013-12-09 05:33:10,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 689200ee >2013-12-09 05:33:15,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b8f2a2e >2013-12-09 05:33:15,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b8f2a2e >2013-12-09 05:33:15,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62b95418 >2013-12-09 05:33:16,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62b95418 >2013-12-09 05:33:21,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44c74784 >2013-12-09 05:33:21,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 44c74784 >2013-12-09 05:33:21,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39e7f8d4 >2013-12-09 05:33:21,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39e7f8d4 >2013-12-09 05:33:26,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 575597ad >2013-12-09 05:33:27,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 575597ad >2013-12-09 05:33:27,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4be47f0f >2013-12-09 05:33:27,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4be47f0f >2013-12-09 05:33:31,421 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) No up server in cluster >2013-12-09 05:33:31,421 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:33:31,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 317bd72d >2013-12-09 05:33:31,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterTasksListVDSCommand, return: [], log id: 317bd72d >2013-12-09 05:33:32,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70a33163 >2013-12-09 05:33:33,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 70a33163 >2013-12-09 05:33:33,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f8f7391 >2013-12-09 05:33:33,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f8f7391 >2013-12-09 05:33:38,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ca3a92 >2013-12-09 05:33:39,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2ca3a92 >2013-12-09 05:33:39,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c11cbae >2013-12-09 05:33:39,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c11cbae >2013-12-09 05:33:44,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 635e5f7b >2013-12-09 05:33:44,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 635e5f7b >2013-12-09 05:33:44,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bc6db0 >2013-12-09 05:33:45,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bc6db0 >2013-12-09 05:33:50,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ec5cbe8 >2013-12-09 05:33:50,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4ec5cbe8 >2013-12-09 05:33:50,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: aeec86d >2013-12-09 05:33:50,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: aeec86d >2013-12-09 05:33:55,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c42f108 >2013-12-09 05:33:56,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5c42f108 >2013-12-09 05:33:56,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6257e068 >2013-12-09 05:33:56,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6257e068 >2013-12-09 05:34:01,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1dd69c89 >2013-12-09 05:34:02,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1dd69c89 >2013-12-09 05:34:02,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 921aa6a >2013-12-09 05:34:02,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 921aa6a >2013-12-09 05:34:07,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 246ae0fe >2013-12-09 05:34:07,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 246ae0fe >2013-12-09 05:34:07,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f9cfab5 >2013-12-09 05:34:08,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f9cfab5 >2013-12-09 05:34:13,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 642a0452 >2013-12-09 05:34:13,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 642a0452 >2013-12-09 05:34:13,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8dbfde2 >2013-12-09 05:34:13,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8dbfde2 >2013-12-09 05:34:18,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4039cf89 >2013-12-09 05:34:19,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4039cf89 >2013-12-09 05:34:19,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 176d9b61 >2013-12-09 05:34:19,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 176d9b61 >2013-12-09 05:34:24,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 484c2fc4 >2013-12-09 05:34:25,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 484c2fc4 >2013-12-09 05:34:25,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68cce667 >2013-12-09 05:34:25,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68cce667 >2013-12-09 05:34:30,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c4e76ba >2013-12-09 05:34:31,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5c4e76ba >2013-12-09 05:34:31,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58e3d7f5 >2013-12-09 05:34:31,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58e3d7f5 >2013-12-09 05:34:31,715 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-14) No up server in cluster >2013-12-09 05:34:31,715 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-14) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:34:31,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57dd4e48 >2013-12-09 05:34:31,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterTasksListVDSCommand, return: [], log id: 57dd4e48 >2013-12-09 05:34:36,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56c8848d >2013-12-09 05:34:36,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 56c8848d >2013-12-09 05:34:36,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 60508f24 >2013-12-09 05:34:37,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60508f24 >2013-12-09 05:34:42,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c11da1e >2013-12-09 05:34:42,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: c11da1e >2013-12-09 05:34:42,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e06f3c1 >2013-12-09 05:34:42,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e06f3c1 >2013-12-09 05:34:47,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4fbbd9d >2013-12-09 05:34:48,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4fbbd9d >2013-12-09 05:34:48,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66eae936 >2013-12-09 05:34:48,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66eae936 >2013-12-09 05:34:53,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41875116 >2013-12-09 05:34:54,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 41875116 >2013-12-09 05:34:54,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c4f8094 >2013-12-09 05:34:54,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c4f8094 >2013-12-09 05:34:59,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65d7074e >2013-12-09 05:34:59,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 65d7074e >2013-12-09 05:35:00,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3efd9415 >2013-12-09 05:35:00,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3efd9415 >2013-12-09 05:35:05,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bc6b766 >2013-12-09 05:35:05,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1bc6b766 >2013-12-09 05:35:05,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76a41ee8 >2013-12-09 05:35:06,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76a41ee8 >2013-12-09 05:35:11,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34540123 >2013-12-09 05:35:11,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 34540123 >2013-12-09 05:35:11,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7bade38a >2013-12-09 05:35:11,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7bade38a >2013-12-09 05:35:16,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3771082b >2013-12-09 05:35:17,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3771082b >2013-12-09 05:35:17,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5beffed0 >2013-12-09 05:35:17,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5beffed0 >2013-12-09 05:35:22,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45ca2799 >2013-12-09 05:35:23,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 45ca2799 >2013-12-09 05:35:23,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64abab30 >2013-12-09 05:35:23,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64abab30 >2013-12-09 05:35:28,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1215e23c >2013-12-09 05:35:28,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1215e23c >2013-12-09 05:35:28,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b336af >2013-12-09 05:35:29,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b336af >2013-12-09 05:35:31,996 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-73) No up server in cluster >2013-12-09 05:35:31,996 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-73) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:35:32,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75919699 >2013-12-09 05:35:32,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterTasksListVDSCommand, return: [], log id: 75919699 >2013-12-09 05:35:34,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33c66a57 >2013-12-09 05:35:34,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 33c66a57 >2013-12-09 05:35:34,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e60201d >2013-12-09 05:35:34,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e60201d >2013-12-09 05:35:39,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55be18a0 >2013-12-09 05:35:40,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 55be18a0 >2013-12-09 05:35:40,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39348176 >2013-12-09 05:35:40,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39348176 >2013-12-09 05:35:45,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6bfa4d67 >2013-12-09 05:35:46,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6bfa4d67 >2013-12-09 05:35:46,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f67f445 >2013-12-09 05:35:46,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f67f445 >2013-12-09 05:35:51,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6fdebc15 >2013-12-09 05:35:52,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6fdebc15 >2013-12-09 05:35:52,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49f35250 >2013-12-09 05:35:52,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49f35250 >2013-12-09 05:35:57,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 113cc4d5 >2013-12-09 05:35:57,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 113cc4d5 >2013-12-09 05:35:57,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74c67a22 >2013-12-09 05:35:58,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74c67a22 >2013-12-09 05:36:03,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6fa1ce79 >2013-12-09 05:36:03,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6fa1ce79 >2013-12-09 05:36:03,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c0776b >2013-12-09 05:36:03,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c0776b >2013-12-09 05:36:08,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a1c663f >2013-12-09 05:36:09,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3a1c663f >2013-12-09 05:36:09,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 407a9fb4 >2013-12-09 05:36:09,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 407a9fb4 >2013-12-09 05:36:14,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71350fa0 >2013-12-09 05:36:15,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 71350fa0 >2013-12-09 05:36:15,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1128e529 >2013-12-09 05:36:15,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1128e529 >2013-12-09 05:36:20,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14229e4e >2013-12-09 05:36:20,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 14229e4e >2013-12-09 05:36:20,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e8f1bdb >2013-12-09 05:36:21,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e8f1bdb >2013-12-09 05:36:26,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c9d8a40 >2013-12-09 05:36:26,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4c9d8a40 >2013-12-09 05:36:26,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a283834 >2013-12-09 05:36:27,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a283834 >2013-12-09 05:36:32,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ee9c4c4 >2013-12-09 05:36:32,280 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-61) No up server in cluster >2013-12-09 05:36:32,280 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-61) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:36:32,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 170ba00e >2013-12-09 05:36:32,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6ee9c4c4 >2013-12-09 05:36:32,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d81b2ae >2013-12-09 05:36:32,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterTasksListVDSCommand, return: [], log id: 170ba00e >2013-12-09 05:36:32,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d81b2ae >2013-12-09 05:36:37,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 762590a >2013-12-09 05:36:38,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 762590a >2013-12-09 05:36:38,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7947d50a >2013-12-09 05:36:38,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7947d50a >2013-12-09 05:36:43,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a6fb0e5 >2013-12-09 05:36:44,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: a6fb0e5 >2013-12-09 05:36:44,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31d0feca >2013-12-09 05:36:44,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31d0feca >2013-12-09 05:36:49,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3764cf44 >2013-12-09 05:36:49,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3764cf44 >2013-12-09 05:36:49,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10c69bb >2013-12-09 05:36:50,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10c69bb >2013-12-09 05:36:55,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43be0f1a >2013-12-09 05:36:55,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 43be0f1a >2013-12-09 05:36:55,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a6072a6 >2013-12-09 05:36:55,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a6072a6 >2013-12-09 05:37:00,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3389a78c >2013-12-09 05:37:01,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3389a78c >2013-12-09 05:37:01,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40e198fa >2013-12-09 05:37:01,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40e198fa >2013-12-09 05:37:06,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 269822f >2013-12-09 05:37:07,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 269822f >2013-12-09 05:37:07,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2122126e >2013-12-09 05:37:07,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2122126e >2013-12-09 05:37:12,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 291d936a >2013-12-09 05:37:12,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 291d936a >2013-12-09 05:37:12,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7af23d9 >2013-12-09 05:37:13,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7af23d9 >2013-12-09 05:37:18,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 181131a0 >2013-12-09 05:37:18,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 181131a0 >2013-12-09 05:37:18,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b6cf401 >2013-12-09 05:37:18,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b6cf401 >2013-12-09 05:37:23,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ccefa33 >2013-12-09 05:37:24,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1ccefa33 >2013-12-09 05:37:24,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ec3641a >2013-12-09 05:37:24,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ec3641a >2013-12-09 05:37:29,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 679555eb >2013-12-09 05:37:30,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 679555eb >2013-12-09 05:37:30,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17ccbef6 >2013-12-09 05:37:30,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17ccbef6 >2013-12-09 05:37:32,556 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-100) No up server in cluster >2013-12-09 05:37:32,556 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-100) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:37:32,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68b461b >2013-12-09 05:37:32,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterTasksListVDSCommand, return: [], log id: 68b461b >2013-12-09 05:37:35,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b192652 >2013-12-09 05:37:36,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b192652 >2013-12-09 05:37:36,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29cc6c1d >2013-12-09 05:37:36,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29cc6c1d >2013-12-09 05:37:41,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6bc256e2 >2013-12-09 05:37:41,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6bc256e2 >2013-12-09 05:37:41,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e506b5f >2013-12-09 05:37:42,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e506b5f >2013-12-09 05:37:47,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27b44202 >2013-12-09 05:37:47,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 27b44202 >2013-12-09 05:37:47,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52f0627a >2013-12-09 05:37:47,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52f0627a >2013-12-09 05:37:52,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72b5c7ec >2013-12-09 05:37:53,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 72b5c7ec >2013-12-09 05:37:53,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a34ce9d >2013-12-09 05:37:53,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a34ce9d >2013-12-09 05:37:58,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d49602e >2013-12-09 05:37:59,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d49602e >2013-12-09 05:37:59,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 771e6da2 >2013-12-09 05:37:59,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 771e6da2 >2013-12-09 05:38:04,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38902980 >2013-12-09 05:38:05,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 38902980 >2013-12-09 05:38:05,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11308005 >2013-12-09 05:38:05,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11308005 >2013-12-09 05:38:10,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6bb1f478 >2013-12-09 05:38:10,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6bb1f478 >2013-12-09 05:38:10,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75e1d8ff >2013-12-09 05:38:11,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75e1d8ff >2013-12-09 05:38:16,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 49a1732a >2013-12-09 05:38:16,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 49a1732a >2013-12-09 05:38:16,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 342bf6ba >2013-12-09 05:38:16,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 342bf6ba >2013-12-09 05:38:21,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11c561f3 >2013-12-09 05:38:22,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 11c561f3 >2013-12-09 05:38:22,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2380a033 >2013-12-09 05:38:22,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2380a033 >2013-12-09 05:38:27,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40adb619 >2013-12-09 05:38:28,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 40adb619 >2013-12-09 05:38:28,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47584cfb >2013-12-09 05:38:28,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47584cfb >2013-12-09 05:38:32,836 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-98) No up server in cluster >2013-12-09 05:38:32,837 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-98) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:38:32,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 179aea9f >2013-12-09 05:38:33,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterTasksListVDSCommand, return: [], log id: 179aea9f >2013-12-09 05:38:33,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 500065c1 >2013-12-09 05:38:33,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 500065c1 >2013-12-09 05:38:33,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 432080d9 >2013-12-09 05:38:34,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 432080d9 >2013-12-09 05:38:39,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b6b7a4 >2013-12-09 05:38:39,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b6b7a4 >2013-12-09 05:38:39,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 417ddd38 >2013-12-09 05:38:39,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 417ddd38 >2013-12-09 05:38:44,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68a8b46b >2013-12-09 05:38:45,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 68a8b46b >2013-12-09 05:38:45,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50eee396 >2013-12-09 05:38:45,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50eee396 >2013-12-09 05:38:50,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c3268a2 >2013-12-09 05:38:51,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c3268a2 >2013-12-09 05:38:51,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30c101b0 >2013-12-09 05:38:51,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30c101b0 >2013-12-09 05:38:56,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34caf1b >2013-12-09 05:38:57,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 34caf1b >2013-12-09 05:38:57,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e2e9c46 >2013-12-09 05:38:57,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e2e9c46 >2013-12-09 05:39:02,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1eb0ef66 >2013-12-09 05:39:02,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1eb0ef66 >2013-12-09 05:39:02,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 726ef09 >2013-12-09 05:39:03,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 726ef09 >2013-12-09 05:39:08,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e00c5e3 >2013-12-09 05:39:08,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e00c5e3 >2013-12-09 05:39:08,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ca7bcdd >2013-12-09 05:39:08,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ca7bcdd >2013-12-09 05:39:13,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 484b27e9 >2013-12-09 05:39:14,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 484b27e9 >2013-12-09 05:39:14,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f1126e9 >2013-12-09 05:39:14,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f1126e9 >2013-12-09 05:39:19,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 25987 >2013-12-09 05:39:20,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 25987 >2013-12-09 05:39:20,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13e2ef49 >2013-12-09 05:39:20,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13e2ef49 >2013-12-09 05:39:25,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f5ace75 >2013-12-09 05:39:25,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f5ace75 >2013-12-09 05:39:25,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66c61fa2 >2013-12-09 05:39:26,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66c61fa2 >2013-12-09 05:39:31,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4729911 >2013-12-09 05:39:31,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4729911 >2013-12-09 05:39:31,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ae88b65 >2013-12-09 05:39:31,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ae88b65 >2013-12-09 05:39:33,118 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-72) No up server in cluster >2013-12-09 05:39:33,118 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-72) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:39:33,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49b00659 >2013-12-09 05:39:33,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterTasksListVDSCommand, return: [], log id: 49b00659 >2013-12-09 05:39:36,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65d4c24f >2013-12-09 05:39:37,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 65d4c24f >2013-12-09 05:39:37,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4289b341 >2013-12-09 05:39:37,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4289b341 >2013-12-09 05:39:42,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43766a32 >2013-12-09 05:39:43,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 43766a32 >2013-12-09 05:39:43,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 295d41c1 >2013-12-09 05:39:43,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 295d41c1 >2013-12-09 05:39:48,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b7162ec >2013-12-09 05:39:49,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1b7162ec >2013-12-09 05:39:49,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39808b57 >2013-12-09 05:39:49,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39808b57 >2013-12-09 05:39:54,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69cb59fc >2013-12-09 05:39:54,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 69cb59fc >2013-12-09 05:39:54,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2be49e8e >2013-12-09 05:39:55,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2be49e8e >2013-12-09 05:40:00,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58de2b19 >2013-12-09 05:40:00,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 58de2b19 >2013-12-09 05:40:00,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4193c63a >2013-12-09 05:40:00,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4193c63a >2013-12-09 05:40:05,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29429272 >2013-12-09 05:40:06,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 29429272 >2013-12-09 05:40:06,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68e8971e >2013-12-09 05:40:06,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68e8971e >2013-12-09 05:40:11,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6bc8104f >2013-12-09 05:40:12,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6bc8104f >2013-12-09 05:40:12,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1bc83ee1 >2013-12-09 05:40:12,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1bc83ee1 >2013-12-09 05:40:17,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76403f07 >2013-12-09 05:40:17,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 76403f07 >2013-12-09 05:40:17,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d5f25d6 >2013-12-09 05:40:18,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d5f25d6 >2013-12-09 05:40:23,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29619b4f >2013-12-09 05:40:23,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 29619b4f >2013-12-09 05:40:23,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c432644 >2013-12-09 05:40:23,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c432644 >2013-12-09 05:40:28,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68bee171 >2013-12-09 05:40:29,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 68bee171 >2013-12-09 05:40:29,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3501240 >2013-12-09 05:40:29,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3501240 >2013-12-09 05:40:33,408 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-76) No up server in cluster >2013-12-09 05:40:33,408 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-76) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:40:33,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1af945ff >2013-12-09 05:40:33,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1af945ff >2013-12-09 05:40:34,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53edd564 >2013-12-09 05:40:35,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 53edd564 >2013-12-09 05:40:35,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21463065 >2013-12-09 05:40:35,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21463065 >2013-12-09 05:40:40,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4fc94423 >2013-12-09 05:40:41,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4fc94423 >2013-12-09 05:40:41,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a99646d >2013-12-09 05:40:41,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a99646d >2013-12-09 05:40:46,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c0af198 >2013-12-09 05:40:46,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c0af198 >2013-12-09 05:40:46,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e792871 >2013-12-09 05:40:47,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e792871 >2013-12-09 05:40:52,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3148e0c8 >2013-12-09 05:40:52,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3148e0c8 >2013-12-09 05:40:52,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c9fa42a >2013-12-09 05:40:52,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c9fa42a >2013-12-09 05:40:57,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 511394c9 >2013-12-09 05:40:58,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 511394c9 >2013-12-09 05:40:58,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3cc2fc98 >2013-12-09 05:40:58,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3cc2fc98 >2013-12-09 05:41:03,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 211da479 >2013-12-09 05:41:04,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 211da479 >2013-12-09 05:41:04,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27f45a65 >2013-12-09 05:41:04,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27f45a65 >2013-12-09 05:41:09,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9348f15 >2013-12-09 05:41:09,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 9348f15 >2013-12-09 05:41:09,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c1a05fd >2013-12-09 05:41:10,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c1a05fd >2013-12-09 05:41:15,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48159aa >2013-12-09 05:41:15,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 48159aa >2013-12-09 05:41:15,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b6ca75f >2013-12-09 05:41:15,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b6ca75f >2013-12-09 05:41:21,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e31f0e4 >2013-12-09 05:41:21,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3e31f0e4 >2013-12-09 05:41:21,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4fb249c >2013-12-09 05:41:21,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fb249c >2013-12-09 05:41:26,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c375aad >2013-12-09 05:41:27,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c375aad >2013-12-09 05:41:27,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1210e96 >2013-12-09 05:41:27,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1210e96 >2013-12-09 05:41:32,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 60ca4a80 >2013-12-09 05:41:33,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 60ca4a80 >2013-12-09 05:41:33,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51ec0ee4 >2013-12-09 05:41:33,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51ec0ee4 >2013-12-09 05:41:33,703 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) No up server in cluster >2013-12-09 05:41:33,703 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:41:33,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33a40478 >2013-12-09 05:41:33,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterTasksListVDSCommand, return: [], log id: 33a40478 >2013-12-09 05:41:38,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 591d8ddb >2013-12-09 05:41:38,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 591d8ddb >2013-12-09 05:41:38,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50bf3fa0 >2013-12-09 05:41:39,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50bf3fa0 >2013-12-09 05:41:44,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58708ae5 >2013-12-09 05:41:44,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 58708ae5 >2013-12-09 05:41:44,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c634f2d >2013-12-09 05:41:44,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c634f2d >2013-12-09 05:41:49,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4504603e >2013-12-09 05:41:50,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4504603e >2013-12-09 05:41:50,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23d80139 >2013-12-09 05:41:50,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23d80139 >2013-12-09 05:41:55,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e72b45c >2013-12-09 05:41:56,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7e72b45c >2013-12-09 05:41:56,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18725a91 >2013-12-09 05:41:56,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18725a91 >2013-12-09 05:42:01,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f7b01c4 >2013-12-09 05:42:01,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f7b01c4 >2013-12-09 05:42:01,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78be4d7b >2013-12-09 05:42:02,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78be4d7b >2013-12-09 05:42:07,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68361a65 >2013-12-09 05:42:07,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 68361a65 >2013-12-09 05:42:07,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6dcb59bd >2013-12-09 05:42:07,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6dcb59bd >2013-12-09 05:42:13,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ba1dfb1 >2013-12-09 05:42:13,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1ba1dfb1 >2013-12-09 05:42:13,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 566f288 >2013-12-09 05:42:13,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 566f288 >2013-12-09 05:42:18,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5333d1bb >2013-12-09 05:42:19,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5333d1bb >2013-12-09 05:42:19,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 92841a8 >2013-12-09 05:42:19,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 92841a8 >2013-12-09 05:42:24,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78a301f7 >2013-12-09 05:42:25,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 78a301f7 >2013-12-09 05:42:25,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a099cd4 >2013-12-09 05:42:25,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a099cd4 >2013-12-09 05:42:30,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 499ee640 >2013-12-09 05:42:30,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 499ee640 >2013-12-09 05:42:30,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a8262ab >2013-12-09 05:42:31,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a8262ab >2013-12-09 05:42:33,977 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-48) No up server in cluster >2013-12-09 05:42:33,977 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-48) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:42:33,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f3fc8e4 >2013-12-09 05:42:34,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6f3fc8e4 >2013-12-09 05:42:36,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ea0d23e >2013-12-09 05:42:36,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ea0d23e >2013-12-09 05:42:36,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65e626ad >2013-12-09 05:42:36,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65e626ad >2013-12-09 05:42:41,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67be34e9 >2013-12-09 05:42:42,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 67be34e9 >2013-12-09 05:42:42,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42455276 >2013-12-09 05:42:42,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42455276 >2013-12-09 05:42:47,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 733c0234 >2013-12-09 05:42:48,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 733c0234 >2013-12-09 05:42:48,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 719e588f >2013-12-09 05:42:48,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 719e588f >2013-12-09 05:42:53,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b9c0e43 >2013-12-09 05:42:53,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b9c0e43 >2013-12-09 05:42:53,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ed84cd2 >2013-12-09 05:42:54,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ed84cd2 >2013-12-09 05:42:59,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2cad458e >2013-12-09 05:42:59,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2cad458e >2013-12-09 05:42:59,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5fee79e1 >2013-12-09 05:42:59,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fee79e1 >2013-12-09 05:43:04,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d3bac83 >2013-12-09 05:43:05,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d3bac83 >2013-12-09 05:43:05,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5384b874 >2013-12-09 05:43:05,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5384b874 >2013-12-09 05:43:10,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 294cf815 >2013-12-09 05:43:11,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 294cf815 >2013-12-09 05:43:11,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77156cf5 >2013-12-09 05:43:11,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77156cf5 >2013-12-09 05:43:16,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54d82629 >2013-12-09 05:43:17,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 54d82629 >2013-12-09 05:43:17,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 362dc99a >2013-12-09 05:43:17,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 362dc99a >2013-12-09 05:43:22,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e1a1d17 >2013-12-09 05:43:22,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e1a1d17 >2013-12-09 05:43:22,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31e09347 >2013-12-09 05:43:23,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31e09347 >2013-12-09 05:43:28,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4fe8d464 >2013-12-09 05:43:28,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4fe8d464 >2013-12-09 05:43:28,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31a4c89 >2013-12-09 05:43:28,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31a4c89 >2013-12-09 05:43:33,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1495cf9a >2013-12-09 05:43:34,258 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-63) No up server in cluster >2013-12-09 05:43:34,258 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-63) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:43:34,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a9363f8 >2013-12-09 05:43:34,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1495cf9a >2013-12-09 05:43:34,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58a785bb >2013-12-09 05:43:34,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterTasksListVDSCommand, return: [], log id: a9363f8 >2013-12-09 05:43:34,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58a785bb >2013-12-09 05:43:39,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 723bb9cb >2013-12-09 05:43:40,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 723bb9cb >2013-12-09 05:43:40,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f707124 >2013-12-09 05:43:40,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f707124 >2013-12-09 05:43:45,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c22e929 >2013-12-09 05:43:45,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c22e929 >2013-12-09 05:43:45,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ac0c73c >2013-12-09 05:43:46,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ac0c73c >2013-12-09 05:43:51,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d3256e5 >2013-12-09 05:43:51,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d3256e5 >2013-12-09 05:43:51,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 675b6ec1 >2013-12-09 05:43:51,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 675b6ec1 >2013-12-09 05:43:56,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5415b6a2 >2013-12-09 05:43:57,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5415b6a2 >2013-12-09 05:43:57,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 257fc813 >2013-12-09 05:43:57,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 257fc813 >2013-12-09 05:44:02,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6db2b7b4 >2013-12-09 05:44:03,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6db2b7b4 >2013-12-09 05:44:03,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e32e250 >2013-12-09 05:44:03,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e32e250 >2013-12-09 05:44:08,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 87c010d >2013-12-09 05:44:09,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 87c010d >2013-12-09 05:44:09,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4904ed30 >2013-12-09 05:44:09,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4904ed30 >2013-12-09 05:44:14,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5808315 >2013-12-09 05:44:14,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5808315 >2013-12-09 05:44:14,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b4c4805 >2013-12-09 05:44:15,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b4c4805 >2013-12-09 05:44:20,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 472665c3 >2013-12-09 05:44:20,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 472665c3 >2013-12-09 05:44:20,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 530f86d3 >2013-12-09 05:44:20,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 530f86d3 >2013-12-09 05:44:25,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 223b8c40 >2013-12-09 05:44:26,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 223b8c40 >2013-12-09 05:44:26,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73196915 >2013-12-09 05:44:26,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73196915 >2013-12-09 05:44:31,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72979539 >2013-12-09 05:44:32,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 72979539 >2013-12-09 05:44:32,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 588c88f1 >2013-12-09 05:44:32,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 588c88f1 >2013-12-09 05:44:34,509 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-42) No up server in cluster >2013-12-09 05:44:34,509 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-42) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:44:34,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18fd668a >2013-12-09 05:44:34,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterTasksListVDSCommand, return: [], log id: 18fd668a >2013-12-09 05:44:37,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a9a0659 >2013-12-09 05:44:38,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a9a0659 >2013-12-09 05:44:38,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16d049d6 >2013-12-09 05:44:38,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16d049d6 >2013-12-09 05:44:43,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 177aa247 >2013-12-09 05:44:43,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 177aa247 >2013-12-09 05:44:43,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59e600a6 >2013-12-09 05:44:44,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59e600a6 >2013-12-09 05:44:49,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5cf6e818 >2013-12-09 05:44:49,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5cf6e818 >2013-12-09 05:44:49,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6000d143 >2013-12-09 05:44:49,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6000d143 >2013-12-09 05:44:54,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bdd94c0 >2013-12-09 05:44:55,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1bdd94c0 >2013-12-09 05:44:55,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 344cffbe >2013-12-09 05:44:55,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 344cffbe >2013-12-09 05:45:00,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6378e1c2 >2013-12-09 05:45:01,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6378e1c2 >2013-12-09 05:45:01,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a24c775 >2013-12-09 05:45:01,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a24c775 >2013-12-09 05:45:06,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43166a1f >2013-12-09 05:45:06,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 43166a1f >2013-12-09 05:45:06,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5eba8ed7 >2013-12-09 05:45:07,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5eba8ed7 >2013-12-09 05:45:12,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66bee496 >2013-12-09 05:45:12,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 66bee496 >2013-12-09 05:45:12,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d1e39aa >2013-12-09 05:45:13,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d1e39aa >2013-12-09 05:45:18,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5df92905 >2013-12-09 05:45:18,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5df92905 >2013-12-09 05:45:18,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a9f7909 >2013-12-09 05:45:18,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a9f7909 >2013-12-09 05:45:23,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5eae693e >2013-12-09 05:45:24,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5eae693e >2013-12-09 05:45:24,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a521823 >2013-12-09 05:45:24,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a521823 >2013-12-09 05:45:29,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6327643a >2013-12-09 05:45:30,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6327643a >2013-12-09 05:45:30,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b0d2331 >2013-12-09 05:45:30,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b0d2331 >2013-12-09 05:45:34,789 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-1) No up server in cluster >2013-12-09 05:45:34,789 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-1) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:45:34,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 210ae651 >2013-12-09 05:45:35,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterTasksListVDSCommand, return: [], log id: 210ae651 >2013-12-09 05:45:35,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70fe47e4 >2013-12-09 05:45:36,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 70fe47e4 >2013-12-09 05:45:36,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69486002 >2013-12-09 05:45:36,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69486002 >2013-12-09 05:45:41,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 273b399a >2013-12-09 05:45:41,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 273b399a >2013-12-09 05:45:41,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b0a1012 >2013-12-09 05:45:42,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b0a1012 >2013-12-09 05:45:47,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52fc380c >2013-12-09 05:45:47,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 52fc380c >2013-12-09 05:45:47,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5153b4df >2013-12-09 05:45:47,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5153b4df >2013-12-09 05:45:52,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b205b0b >2013-12-09 05:45:53,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b205b0b >2013-12-09 05:45:53,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2cead53a >2013-12-09 05:45:53,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2cead53a >2013-12-09 05:45:58,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4eab3fc8 >2013-12-09 05:45:59,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4eab3fc8 >2013-12-09 05:45:59,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d29f604 >2013-12-09 05:45:59,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d29f604 >2013-12-09 05:46:04,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f6cbb7d >2013-12-09 05:46:04,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: f6cbb7d >2013-12-09 05:46:04,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c2132bc >2013-12-09 05:46:05,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c2132bc >2013-12-09 05:46:10,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 766c8415 >2013-12-09 05:46:10,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 766c8415 >2013-12-09 05:46:10,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ec43746 >2013-12-09 05:46:10,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ec43746 >2013-12-09 05:46:15,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48515 >2013-12-09 05:46:16,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 48515 >2013-12-09 05:46:16,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17e894d5 >2013-12-09 05:46:16,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17e894d5 >2013-12-09 05:46:21,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ed441e1 >2013-12-09 05:46:22,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7ed441e1 >2013-12-09 05:46:22,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 388f2e24 >2013-12-09 05:46:22,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 388f2e24 >2013-12-09 05:46:27,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19ff67b8 >2013-12-09 05:46:27,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19ff67b8 >2013-12-09 05:46:28,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 206a11da >2013-12-09 05:46:28,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 206a11da >2013-12-09 05:46:33,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76aae752 >2013-12-09 05:46:33,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 76aae752 >2013-12-09 05:46:33,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a77cdae >2013-12-09 05:46:34,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a77cdae >2013-12-09 05:46:35,061 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-90) No up server in cluster >2013-12-09 05:46:35,061 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-90) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:46:35,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 60c59238 >2013-12-09 05:46:35,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterTasksListVDSCommand, return: [], log id: 60c59238 >2013-12-09 05:46:39,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f70e136 >2013-12-09 05:46:39,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f70e136 >2013-12-09 05:46:39,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 702ed387 >2013-12-09 05:46:39,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 702ed387 >2013-12-09 05:46:44,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1500bdbc >2013-12-09 05:46:45,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1500bdbc >2013-12-09 05:46:45,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e1b1e2b >2013-12-09 05:46:45,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e1b1e2b >2013-12-09 05:46:50,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f353924 >2013-12-09 05:46:51,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f353924 >2013-12-09 05:46:51,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b387a2b >2013-12-09 05:46:51,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b387a2b >2013-12-09 05:46:56,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 112755ee >2013-12-09 05:46:56,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 112755ee >2013-12-09 05:46:56,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57faefe6 >2013-12-09 05:46:57,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57faefe6 >2013-12-09 05:47:02,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 698d530c >2013-12-09 05:47:02,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 698d530c >2013-12-09 05:47:02,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f26ce70 >2013-12-09 05:47:02,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f26ce70 >2013-12-09 05:47:07,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5459aead >2013-12-09 05:47:08,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5459aead >2013-12-09 05:47:08,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c444aa5 >2013-12-09 05:47:08,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c444aa5 >2013-12-09 05:47:13,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4fe1e27 >2013-12-09 05:47:14,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4fe1e27 >2013-12-09 05:47:14,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f8e5384 >2013-12-09 05:47:14,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f8e5384 >2013-12-09 05:47:19,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34c01d50 >2013-12-09 05:47:19,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 34c01d50 >2013-12-09 05:47:19,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6cc443c >2013-12-09 05:47:20,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6cc443c >2013-12-09 05:47:25,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 735d0740 >2013-12-09 05:47:25,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 735d0740 >2013-12-09 05:47:25,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 430b7e6d >2013-12-09 05:47:25,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 430b7e6d >2013-12-09 05:47:30,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b942ce4 >2013-12-09 05:47:31,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b942ce4 >2013-12-09 05:47:31,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10f9aab4 >2013-12-09 05:47:31,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10f9aab4 >2013-12-09 05:47:35,348 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-79) No up server in cluster >2013-12-09 05:47:35,348 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-79) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:47:35,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4865a3b5 >2013-12-09 05:47:35,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4865a3b5 >2013-12-09 05:47:36,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ff0ae74 >2013-12-09 05:47:37,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ff0ae74 >2013-12-09 05:47:37,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b5477fc >2013-12-09 05:47:37,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b5477fc >2013-12-09 05:47:42,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b1244a7 >2013-12-09 05:47:42,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4b1244a7 >2013-12-09 05:47:42,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3fb86ffc >2013-12-09 05:47:43,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3fb86ffc >2013-12-09 05:47:48,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f357e3 >2013-12-09 05:47:48,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f357e3 >2013-12-09 05:47:48,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37cfb6d5 >2013-12-09 05:47:49,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37cfb6d5 >2013-12-09 05:47:54,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6576c959 >2013-12-09 05:47:54,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6576c959 >2013-12-09 05:47:54,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7390077f >2013-12-09 05:47:54,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7390077f >2013-12-09 05:47:59,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a796559 >2013-12-09 05:48:00,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a796559 >2013-12-09 05:48:00,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67859b33 >2013-12-09 05:48:00,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67859b33 >2013-12-09 05:48:05,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f967959 >2013-12-09 05:48:06,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f967959 >2013-12-09 05:48:06,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72a6c2fa >2013-12-09 05:48:06,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72a6c2fa >2013-12-09 05:48:11,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 261239d5 >2013-12-09 05:48:11,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 261239d5 >2013-12-09 05:48:11,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f6c7376 >2013-12-09 05:48:12,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f6c7376 >2013-12-09 05:48:17,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ee35db1 >2013-12-09 05:48:17,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2ee35db1 >2013-12-09 05:48:17,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56d209ef >2013-12-09 05:48:17,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56d209ef >2013-12-09 05:48:22,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b171dcf >2013-12-09 05:48:23,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5b171dcf >2013-12-09 05:48:23,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46a13be2 >2013-12-09 05:48:23,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46a13be2 >2013-12-09 05:48:28,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11e72401 >2013-12-09 05:48:29,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 11e72401 >2013-12-09 05:48:29,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 182d30e5 >2013-12-09 05:48:29,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 182d30e5 >2013-12-09 05:48:34,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c442fa1 >2013-12-09 05:48:34,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2c442fa1 >2013-12-09 05:48:34,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64c4f48e >2013-12-09 05:48:35,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64c4f48e >2013-12-09 05:48:35,628 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-69) No up server in cluster >2013-12-09 05:48:35,628 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-69) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:48:35,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5285c841 >2013-12-09 05:48:35,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5285c841 >2013-12-09 05:48:40,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66c3b595 >2013-12-09 05:48:40,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 66c3b595 >2013-12-09 05:48:40,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6cbe292a >2013-12-09 05:48:41,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6cbe292a >2013-12-09 05:48:46,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b37b577 >2013-12-09 05:48:46,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b37b577 >2013-12-09 05:48:46,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35161df1 >2013-12-09 05:48:46,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35161df1 >2013-12-09 05:48:51,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 492fceb >2013-12-09 05:48:52,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 492fceb >2013-12-09 05:48:52,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64b5e7f2 >2013-12-09 05:48:52,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64b5e7f2 >2013-12-09 05:48:57,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50498b82 >2013-12-09 05:48:58,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 50498b82 >2013-12-09 05:48:58,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45f84f19 >2013-12-09 05:48:58,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45f84f19 >2013-12-09 05:49:03,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7704bd59 >2013-12-09 05:49:03,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7704bd59 >2013-12-09 05:49:03,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7aa541e0 >2013-12-09 05:49:04,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7aa541e0 >2013-12-09 05:49:09,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67309262 >2013-12-09 05:49:09,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 67309262 >2013-12-09 05:49:09,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 120f145 >2013-12-09 05:49:09,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 120f145 >2013-12-09 05:49:14,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42e9386a >2013-12-09 05:49:15,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42e9386a >2013-12-09 05:49:15,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d7a2f64 >2013-12-09 05:49:15,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d7a2f64 >2013-12-09 05:49:20,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32402124 >2013-12-09 05:49:21,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 32402124 >2013-12-09 05:49:21,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43d68a7e >2013-12-09 05:49:21,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43d68a7e >2013-12-09 05:49:26,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57226c0 >2013-12-09 05:49:26,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 57226c0 >2013-12-09 05:49:26,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 407c237 >2013-12-09 05:49:27,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 407c237 >2013-12-09 05:49:32,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bb1d4d5 >2013-12-09 05:49:32,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1bb1d4d5 >2013-12-09 05:49:32,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 112728b6 >2013-12-09 05:49:33,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 112728b6 >2013-12-09 05:49:35,914 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) No up server in cluster >2013-12-09 05:49:35,914 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:49:35,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a21d9e8 >2013-12-09 05:49:36,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5a21d9e8 >2013-12-09 05:49:38,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35f01e46 >2013-12-09 05:49:38,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 35f01e46 >2013-12-09 05:49:38,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9b18ba1 >2013-12-09 05:49:38,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9b18ba1 >2013-12-09 05:49:43,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25d2ce3c >2013-12-09 05:49:44,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 25d2ce3c >2013-12-09 05:49:44,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 516b6b25 >2013-12-09 05:49:44,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 516b6b25 >2013-12-09 05:49:49,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5de23d3d >2013-12-09 05:49:50,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5de23d3d >2013-12-09 05:49:50,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33d6014e >2013-12-09 05:49:50,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33d6014e >2013-12-09 05:49:55,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25653710 >2013-12-09 05:49:55,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 25653710 >2013-12-09 05:49:55,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18afd751 >2013-12-09 05:49:56,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18afd751 >2013-12-09 05:50:01,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f7a8c35 >2013-12-09 05:50:01,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1f7a8c35 >2013-12-09 05:50:01,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28a9428e >2013-12-09 05:50:01,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28a9428e >2013-12-09 05:50:06,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1137cca0 >2013-12-09 05:50:07,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1137cca0 >2013-12-09 05:50:07,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1392fc6f >2013-12-09 05:50:07,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1392fc6f >2013-12-09 05:50:12,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41d266fb >2013-12-09 05:50:13,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 41d266fb >2013-12-09 05:50:13,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 582f10f4 >2013-12-09 05:50:13,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 582f10f4 >2013-12-09 05:50:18,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a5e7658 >2013-12-09 05:50:19,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a5e7658 >2013-12-09 05:50:19,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16567a2d >2013-12-09 05:50:19,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16567a2d >2013-12-09 05:50:24,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 602900a8 >2013-12-09 05:50:24,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 602900a8 >2013-12-09 05:50:24,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6dd928e8 >2013-12-09 05:50:25,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6dd928e8 >2013-12-09 05:50:30,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63c134dd >2013-12-09 05:50:30,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 63c134dd >2013-12-09 05:50:30,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: fc69db8 >2013-12-09 05:50:30,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: fc69db8 >2013-12-09 05:50:35,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 185f7738 >2013-12-09 05:50:36,187 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-7) No up server in cluster >2013-12-09 05:50:36,187 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-7) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:50:36,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e2fea3f >2013-12-09 05:50:36,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 185f7738 >2013-12-09 05:50:36,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49a5ab21 >2013-12-09 05:50:36,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1e2fea3f >2013-12-09 05:50:36,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49a5ab21 >2013-12-09 05:50:41,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3080517d >2013-12-09 05:50:42,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3080517d >2013-12-09 05:50:42,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1447e865 >2013-12-09 05:50:42,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1447e865 >2013-12-09 05:50:47,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b2abc75 >2013-12-09 05:50:47,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b2abc75 >2013-12-09 05:50:47,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b028fae >2013-12-09 05:50:48,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b028fae >2013-12-09 05:50:53,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b4c0caf >2013-12-09 05:50:53,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3b4c0caf >2013-12-09 05:50:53,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 369b3bdc >2013-12-09 05:50:53,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 369b3bdc >2013-12-09 05:50:58,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c8c9db7 >2013-12-09 05:50:59,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2c8c9db7 >2013-12-09 05:50:59,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b6c0383 >2013-12-09 05:50:59,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b6c0383 >2013-12-09 05:51:04,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3824c012 >2013-12-09 05:51:05,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3824c012 >2013-12-09 05:51:05,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 349a1a5b >2013-12-09 05:51:05,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 349a1a5b >2013-12-09 05:51:10,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3fbea0ec >2013-12-09 05:51:11,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3fbea0ec >2013-12-09 05:51:11,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 436ee80d >2013-12-09 05:51:11,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 436ee80d >2013-12-09 05:51:16,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46a02238 >2013-12-09 05:51:16,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 46a02238 >2013-12-09 05:51:16,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74968a33 >2013-12-09 05:51:17,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74968a33 >2013-12-09 05:51:22,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 730a56a3 >2013-12-09 05:51:22,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 730a56a3 >2013-12-09 05:51:22,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7469a0af >2013-12-09 05:51:22,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7469a0af >2013-12-09 05:51:27,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12f93cdf >2013-12-09 05:51:28,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 12f93cdf >2013-12-09 05:51:28,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 695c2a32 >2013-12-09 05:51:28,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 695c2a32 >2013-12-09 05:51:33,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c5f0ea7 >2013-12-09 05:51:34,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3c5f0ea7 >2013-12-09 05:51:34,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 613bbfac >2013-12-09 05:51:34,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 613bbfac >2013-12-09 05:51:36,439 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-14) No up server in cluster >2013-12-09 05:51:36,439 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-14) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:51:36,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30f90295 >2013-12-09 05:51:36,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterTasksListVDSCommand, return: [], log id: 30f90295 >2013-12-09 05:51:39,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d92ca03 >2013-12-09 05:51:39,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4d92ca03 >2013-12-09 05:51:39,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37bcad64 >2013-12-09 05:51:40,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37bcad64 >2013-12-09 05:51:45,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c7ebd64 >2013-12-09 05:51:45,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c7ebd64 >2013-12-09 05:51:45,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67cbfc8f >2013-12-09 05:51:45,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67cbfc8f >2013-12-09 05:51:50,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21596550 >2013-12-09 05:51:51,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 21596550 >2013-12-09 05:51:51,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23e490e9 >2013-12-09 05:51:51,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23e490e9 >2013-12-09 05:51:56,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52f3127c >2013-12-09 05:51:57,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 52f3127c >2013-12-09 05:51:57,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 85ec4b5 >2013-12-09 05:51:57,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 85ec4b5 >2013-12-09 05:52:02,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74b9d696 >2013-12-09 05:52:03,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 74b9d696 >2013-12-09 05:52:03,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1928849 >2013-12-09 05:52:03,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1928849 >2013-12-09 05:52:08,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 526aa1d8 >2013-12-09 05:52:08,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 526aa1d8 >2013-12-09 05:52:08,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ec610c1 >2013-12-09 05:52:09,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ec610c1 >2013-12-09 05:52:14,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b9326d6 >2013-12-09 05:52:14,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b9326d6 >2013-12-09 05:52:14,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 138a5dff >2013-12-09 05:52:14,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 138a5dff >2013-12-09 05:52:19,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e12a1c6 >2013-12-09 05:52:20,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7e12a1c6 >2013-12-09 05:52:20,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58d09f10 >2013-12-09 05:52:20,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58d09f10 >2013-12-09 05:52:25,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: efb57fb >2013-12-09 05:52:26,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: efb57fb >2013-12-09 05:52:26,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c640d4 >2013-12-09 05:52:26,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c640d4 >2013-12-09 05:52:31,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b79d942 >2013-12-09 05:52:31,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b79d942 >2013-12-09 05:52:31,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5abce11a >2013-12-09 05:52:32,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5abce11a >2013-12-09 05:52:36,725 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-29) No up server in cluster >2013-12-09 05:52:36,726 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-29) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:52:36,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21a24f55 >2013-12-09 05:52:37,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterTasksListVDSCommand, return: [], log id: 21a24f55 >2013-12-09 05:52:37,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e3bdf11 >2013-12-09 05:52:37,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e3bdf11 >2013-12-09 05:52:37,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1098181e >2013-12-09 05:52:37,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1098181e >2013-12-09 05:52:43,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: fe73385 >2013-12-09 05:52:43,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: fe73385 >2013-12-09 05:52:43,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a978daf >2013-12-09 05:52:43,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a978daf >2013-12-09 05:52:48,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e219790 >2013-12-09 05:52:49,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e219790 >2013-12-09 05:52:49,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f60bd09 >2013-12-09 05:52:49,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f60bd09 >2013-12-09 05:52:54,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34019aa8 >2013-12-09 05:52:55,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 34019aa8 >2013-12-09 05:52:55,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 722461e >2013-12-09 05:52:55,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 722461e >2013-12-09 05:53:00,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f5c04c2 >2013-12-09 05:53:00,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f5c04c2 >2013-12-09 05:53:00,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26978f83 >2013-12-09 05:53:01,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26978f83 >2013-12-09 05:53:06,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d98d341 >2013-12-09 05:53:06,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d98d341 >2013-12-09 05:53:06,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f76453d >2013-12-09 05:53:06,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f76453d >2013-12-09 05:53:11,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c7d212e >2013-12-09 05:53:12,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5c7d212e >2013-12-09 05:53:12,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f6deb5f >2013-12-09 05:53:12,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f6deb5f >2013-12-09 05:53:17,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: fd7b1c3 >2013-12-09 05:53:18,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: fd7b1c3 >2013-12-09 05:53:18,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 376257ce >2013-12-09 05:53:18,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 376257ce >2013-12-09 05:53:23,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c28a973 >2013-12-09 05:53:23,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5c28a973 >2013-12-09 05:53:23,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33b0a852 >2013-12-09 05:53:24,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33b0a852 >2013-12-09 05:53:29,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 666ee327 >2013-12-09 05:53:29,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 666ee327 >2013-12-09 05:53:29,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10a1476e >2013-12-09 05:53:29,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10a1476e >2013-12-09 05:53:34,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b4225ab >2013-12-09 05:53:35,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b4225ab >2013-12-09 05:53:35,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73826d1e >2013-12-09 05:53:35,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73826d1e >2013-12-09 05:53:37,007 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-48) No up server in cluster >2013-12-09 05:53:37,008 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-48) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:53:37,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 434555ac >2013-12-09 05:53:37,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterTasksListVDSCommand, return: [], log id: 434555ac >2013-12-09 05:53:40,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 529effe2 >2013-12-09 05:53:41,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 529effe2 >2013-12-09 05:53:41,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1dd42f5d >2013-12-09 05:53:41,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1dd42f5d >2013-12-09 05:53:46,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 624cf6a5 >2013-12-09 05:53:47,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 624cf6a5 >2013-12-09 05:53:47,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 559646d8 >2013-12-09 05:53:47,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 559646d8 >2013-12-09 05:53:52,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 49d73a1d >2013-12-09 05:53:52,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 49d73a1d >2013-12-09 05:53:52,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d3da4fe >2013-12-09 05:53:53,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d3da4fe >2013-12-09 05:53:58,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 538f3788 >2013-12-09 05:53:58,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 538f3788 >2013-12-09 05:53:58,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6114a87 >2013-12-09 05:53:58,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6114a87 >2013-12-09 05:54:03,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c03d0f >2013-12-09 05:54:04,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3c03d0f >2013-12-09 05:54:04,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3be420b5 >2013-12-09 05:54:04,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3be420b5 >2013-12-09 05:54:09,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f6bf147 >2013-12-09 05:54:10,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6f6bf147 >2013-12-09 05:54:10,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c2438c2 >2013-12-09 05:54:10,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c2438c2 >2013-12-09 05:54:15,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6738c76f >2013-12-09 05:54:15,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6738c76f >2013-12-09 05:54:15,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 774ccb11 >2013-12-09 05:54:16,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 774ccb11 >2013-12-09 05:54:21,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77e59228 >2013-12-09 05:54:21,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 77e59228 >2013-12-09 05:54:21,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5006a614 >2013-12-09 05:54:22,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5006a614 >2013-12-09 05:54:27,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 587dcb57 >2013-12-09 05:54:27,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 587dcb57 >2013-12-09 05:54:27,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c75dc5c >2013-12-09 05:54:27,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c75dc5c >2013-12-09 05:54:32,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55e67665 >2013-12-09 05:54:33,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 55e67665 >2013-12-09 05:54:33,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a6e292c >2013-12-09 05:54:33,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a6e292c >2013-12-09 05:54:37,283 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-54) No up server in cluster >2013-12-09 05:54:37,283 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-54) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:54:37,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 464f3536 >2013-12-09 05:54:37,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterTasksListVDSCommand, return: [], log id: 464f3536 >2013-12-09 05:54:38,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12c72c00 >2013-12-09 05:54:39,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 12c72c00 >2013-12-09 05:54:39,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 519ea7de >2013-12-09 05:54:39,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 519ea7de >2013-12-09 05:54:44,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6657efdf >2013-12-09 05:54:44,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6657efdf >2013-12-09 05:54:44,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5bb78730 >2013-12-09 05:54:45,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5bb78730 >2013-12-09 05:54:50,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ac91125 >2013-12-09 05:54:50,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1ac91125 >2013-12-09 05:54:50,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f74edf >2013-12-09 05:54:50,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f74edf >2013-12-09 05:54:55,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d0fd18a >2013-12-09 05:54:56,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5d0fd18a >2013-12-09 05:54:56,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 766c22b5 >2013-12-09 05:54:56,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 766c22b5 >2013-12-09 05:55:01,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e664baa >2013-12-09 05:55:02,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e664baa >2013-12-09 05:55:02,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59457890 >2013-12-09 05:55:02,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59457890 >2013-12-09 05:55:07,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1aefb8d5 >2013-12-09 05:55:08,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1aefb8d5 >2013-12-09 05:55:08,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d9f4df3 >2013-12-09 05:55:08,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d9f4df3 >2013-12-09 05:55:13,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4076cb >2013-12-09 05:55:13,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4076cb >2013-12-09 05:55:13,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c87281a >2013-12-09 05:55:14,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c87281a >2013-12-09 05:55:19,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7bea0173 >2013-12-09 05:55:19,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7bea0173 >2013-12-09 05:55:19,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19d3e126 >2013-12-09 05:55:19,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19d3e126 >2013-12-09 05:55:24,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ee3348d >2013-12-09 05:55:25,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ee3348d >2013-12-09 05:55:25,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78e1902d >2013-12-09 05:55:25,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78e1902d >2013-12-09 05:55:30,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b1c485c >2013-12-09 05:55:31,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4b1c485c >2013-12-09 05:55:31,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47448a1b >2013-12-09 05:55:31,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47448a1b >2013-12-09 05:55:36,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47624080 >2013-12-09 05:55:36,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 47624080 >2013-12-09 05:55:36,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c158b25 >2013-12-09 05:55:37,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c158b25 >2013-12-09 05:55:37,558 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-10) No up server in cluster >2013-12-09 05:55:37,559 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-10) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:55:37,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 148c10c5 >2013-12-09 05:55:37,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterTasksListVDSCommand, return: [], log id: 148c10c5 >2013-12-09 05:55:42,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 689533cf >2013-12-09 05:55:42,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 689533cf >2013-12-09 05:55:42,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 150c8a1c >2013-12-09 05:55:42,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 150c8a1c >2013-12-09 05:55:47,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 49941bb2 >2013-12-09 05:55:48,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 49941bb2 >2013-12-09 05:55:48,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27bfd08d >2013-12-09 05:55:48,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27bfd08d >2013-12-09 05:55:53,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e7e52df >2013-12-09 05:55:54,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3e7e52df >2013-12-09 05:55:54,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f8fee12 >2013-12-09 05:55:54,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f8fee12 >2013-12-09 05:55:59,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48a1d347 >2013-12-09 05:56:00,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 48a1d347 >2013-12-09 05:56:00,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e592c8e >2013-12-09 05:56:00,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e592c8e >2013-12-09 05:56:05,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f138a96 >2013-12-09 05:56:05,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5f138a96 >2013-12-09 05:56:05,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f696299 >2013-12-09 05:56:06,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f696299 >2013-12-09 05:56:11,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 547e8f8c >2013-12-09 05:56:11,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 547e8f8c >2013-12-09 05:56:11,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3cf94b8f >2013-12-09 05:56:11,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3cf94b8f >2013-12-09 05:56:16,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bba6e6e >2013-12-09 05:56:17,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4bba6e6e >2013-12-09 05:56:17,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 580d4b29 >2013-12-09 05:56:17,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 580d4b29 >2013-12-09 05:56:22,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d24d1cc >2013-12-09 05:56:23,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6d24d1cc >2013-12-09 05:56:23,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c681077 >2013-12-09 05:56:23,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c681077 >2013-12-09 05:56:28,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3514e81a >2013-12-09 05:56:28,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3514e81a >2013-12-09 05:56:28,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11710d79 >2013-12-09 05:56:29,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11710d79 >2013-12-09 05:56:34,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4290d71 >2013-12-09 05:56:34,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4290d71 >2013-12-09 05:56:34,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: bd64e39 >2013-12-09 05:56:34,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: bd64e39 >2013-12-09 05:56:37,849 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-92) No up server in cluster >2013-12-09 05:56:37,849 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-92) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:56:37,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2dcda910 >2013-12-09 05:56:38,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2dcda910 >2013-12-09 05:56:40,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30d04232 >2013-12-09 05:56:40,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 30d04232 >2013-12-09 05:56:40,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4354db0d >2013-12-09 05:56:40,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4354db0d >2013-12-09 05:56:45,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b4030ca >2013-12-09 05:56:46,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b4030ca >2013-12-09 05:56:46,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10cfeee4 >2013-12-09 05:56:46,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10cfeee4 >2013-12-09 05:56:51,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71fef167 >2013-12-09 05:56:52,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 71fef167 >2013-12-09 05:56:52,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36fd4ee3 >2013-12-09 05:56:52,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36fd4ee3 >2013-12-09 05:56:57,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 327a7b3e >2013-12-09 05:56:57,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 327a7b3e >2013-12-09 05:56:57,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a95c938 >2013-12-09 05:56:58,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a95c938 >2013-12-09 05:57:03,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7dfa933d >2013-12-09 05:57:03,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7dfa933d >2013-12-09 05:57:03,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b3aeb9b >2013-12-09 05:57:03,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b3aeb9b >2013-12-09 05:57:08,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a8d6564 >2013-12-09 05:57:09,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a8d6564 >2013-12-09 05:57:09,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 603be14d >2013-12-09 05:57:09,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 603be14d >2013-12-09 05:57:14,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47b1cfce >2013-12-09 05:57:15,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 47b1cfce >2013-12-09 05:57:15,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7cb5e662 >2013-12-09 05:57:15,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7cb5e662 >2013-12-09 05:57:20,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ef7b553 >2013-12-09 05:57:21,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1ef7b553 >2013-12-09 05:57:21,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67268ae2 >2013-12-09 05:57:21,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67268ae2 >2013-12-09 05:57:26,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 533b36c8 >2013-12-09 05:57:26,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 533b36c8 >2013-12-09 05:57:26,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13ea197c >2013-12-09 05:57:27,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13ea197c >2013-12-09 05:57:32,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78b37c7c >2013-12-09 05:57:32,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 78b37c7c >2013-12-09 05:57:32,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21bb9528 >2013-12-09 05:57:32,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21bb9528 >2013-12-09 05:57:37,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39b611d0 >2013-12-09 05:57:38,138 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-18) No up server in cluster >2013-12-09 05:57:38,138 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-18) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:57:38,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25571b26 >2013-12-09 05:57:38,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 39b611d0 >2013-12-09 05:57:38,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48de9687 >2013-12-09 05:57:38,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterTasksListVDSCommand, return: [], log id: 25571b26 >2013-12-09 05:57:38,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48de9687 >2013-12-09 05:57:43,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f748edd >2013-12-09 05:57:44,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f748edd >2013-12-09 05:57:44,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 642e18c3 >2013-12-09 05:57:44,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 642e18c3 >2013-12-09 05:57:49,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16af6651 >2013-12-09 05:57:49,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 16af6651 >2013-12-09 05:57:49,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58732cfa >2013-12-09 05:57:50,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58732cfa >2013-12-09 05:57:55,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6dce741 >2013-12-09 05:57:55,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6dce741 >2013-12-09 05:57:55,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 671cbcce >2013-12-09 05:57:55,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 671cbcce >2013-12-09 05:58:00,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c4a4985 >2013-12-09 05:58:01,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4c4a4985 >2013-12-09 05:58:01,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f010319 >2013-12-09 05:58:01,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f010319 >2013-12-09 05:58:06,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16893e77 >2013-12-09 05:58:07,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 16893e77 >2013-12-09 05:58:07,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 568e1e77 >2013-12-09 05:58:07,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 568e1e77 >2013-12-09 05:58:12,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d099728 >2013-12-09 05:58:12,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d099728 >2013-12-09 05:58:12,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24be3a0d >2013-12-09 05:58:13,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24be3a0d >2013-12-09 05:58:18,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 713cb93e >2013-12-09 05:58:18,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 713cb93e >2013-12-09 05:58:18,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7da49d7 >2013-12-09 05:58:18,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7da49d7 >2013-12-09 05:58:24,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 210e7913 >2013-12-09 05:58:24,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 210e7913 >2013-12-09 05:58:24,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f5086ee >2013-12-09 05:58:24,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f5086ee >2013-12-09 05:58:29,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1fc083af >2013-12-09 05:58:30,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1fc083af >2013-12-09 05:58:30,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30f0e9c8 >2013-12-09 05:58:30,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30f0e9c8 >2013-12-09 05:58:35,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 497b534d >2013-12-09 05:58:36,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 497b534d >2013-12-09 05:58:36,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d31f778 >2013-12-09 05:58:36,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d31f778 >2013-12-09 05:58:38,377 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-97) No up server in cluster >2013-12-09 05:58:38,378 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-97) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:58:38,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64f15442 >2013-12-09 05:58:38,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterTasksListVDSCommand, return: [], log id: 64f15442 >2013-12-09 05:58:41,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65564aff >2013-12-09 05:58:41,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 65564aff >2013-12-09 05:58:41,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47349e64 >2013-12-09 05:58:42,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47349e64 >2013-12-09 05:58:47,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56ccc0c4 >2013-12-09 05:58:47,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 56ccc0c4 >2013-12-09 05:58:47,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 394a9f6c >2013-12-09 05:58:47,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 394a9f6c >2013-12-09 05:58:52,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a42d397 >2013-12-09 05:58:53,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a42d397 >2013-12-09 05:58:53,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b93efc1 >2013-12-09 05:58:53,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b93efc1 >2013-12-09 05:58:58,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66491c46 >2013-12-09 05:58:59,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 66491c46 >2013-12-09 05:58:59,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a654da3 >2013-12-09 05:58:59,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a654da3 >2013-12-09 05:59:04,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ecdd2fb >2013-12-09 05:59:04,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ecdd2fb >2013-12-09 05:59:04,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4891b714 >2013-12-09 05:59:05,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4891b714 >2013-12-09 05:59:10,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8b2ef2c >2013-12-09 05:59:10,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 8b2ef2c >2013-12-09 05:59:10,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1de02024 >2013-12-09 05:59:11,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1de02024 >2013-12-09 05:59:16,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75bb015e >2013-12-09 05:59:16,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 75bb015e >2013-12-09 05:59:16,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5587981a >2013-12-09 05:59:16,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5587981a >2013-12-09 05:59:21,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a90f1aa >2013-12-09 05:59:22,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1a90f1aa >2013-12-09 05:59:22,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 311c2368 >2013-12-09 05:59:22,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 311c2368 >2013-12-09 05:59:27,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68b4e7c0 >2013-12-09 05:59:28,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 68b4e7c0 >2013-12-09 05:59:28,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ae70f82 >2013-12-09 05:59:28,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ae70f82 >2013-12-09 05:59:33,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63c075a4 >2013-12-09 05:59:33,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 63c075a4 >2013-12-09 05:59:33,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d1cd278 >2013-12-09 05:59:34,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d1cd278 >2013-12-09 05:59:38,650 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-100) No up server in cluster >2013-12-09 05:59:38,650 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-100) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 05:59:38,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57786b20 >2013-12-09 05:59:38,731 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-50) Attempting to update VMs/Templates Ovf. >2013-12-09 05:59:38,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterTasksListVDSCommand, return: [], log id: 57786b20 >2013-12-09 05:59:39,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4810cf13 >2013-12-09 05:59:39,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4810cf13 >2013-12-09 05:59:39,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18346036 >2013-12-09 05:59:39,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18346036 >2013-12-09 05:59:44,342 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-35) Start refreshing all users data >2013-12-09 05:59:44,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c31848e >2013-12-09 05:59:45,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6c31848e >2013-12-09 05:59:45,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d8b8dae >2013-12-09 05:59:45,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d8b8dae >2013-12-09 05:59:50,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36273479 >2013-12-09 05:59:51,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 36273479 >2013-12-09 05:59:51,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d5387eb >2013-12-09 05:59:51,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d5387eb >2013-12-09 05:59:56,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f72c41b >2013-12-09 05:59:56,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f72c41b >2013-12-09 05:59:56,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2923e827 >2013-12-09 05:59:57,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2923e827 >2013-12-09 06:00:02,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c8505c9 >2013-12-09 06:00:02,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6c8505c9 >2013-12-09 06:00:02,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 414c9aeb >2013-12-09 06:00:02,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 414c9aeb >2013-12-09 06:00:07,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4bc0737c >2013-12-09 06:00:08,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4bc0737c >2013-12-09 06:00:08,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c5441 >2013-12-09 06:00:08,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c5441 >2013-12-09 06:00:13,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f06dd92 >2013-12-09 06:00:14,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f06dd92 >2013-12-09 06:00:14,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1af811d2 >2013-12-09 06:00:14,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1af811d2 >2013-12-09 06:00:19,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51a6aab8 >2013-12-09 06:00:20,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 51a6aab8 >2013-12-09 06:00:20,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5bfdcc58 >2013-12-09 06:00:20,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5bfdcc58 >2013-12-09 06:00:25,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4442433c >2013-12-09 06:00:25,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4442433c >2013-12-09 06:00:25,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47383abf >2013-12-09 06:00:26,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47383abf >2013-12-09 06:00:31,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f8a3e07 >2013-12-09 06:00:31,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: f8a3e07 >2013-12-09 06:00:31,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ed47cc4 >2013-12-09 06:00:31,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ed47cc4 >2013-12-09 06:00:36,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1105eb46 >2013-12-09 06:00:37,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1105eb46 >2013-12-09 06:00:37,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 390285f5 >2013-12-09 06:00:37,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 390285f5 >2013-12-09 06:00:38,917 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-54) No up server in cluster >2013-12-09 06:00:38,917 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-54) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:00:38,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3193ed3d >2013-12-09 06:00:39,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3193ed3d >2013-12-09 06:00:42,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7800f068 >2013-12-09 06:00:43,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7800f068 >2013-12-09 06:00:43,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66d49405 >2013-12-09 06:00:43,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66d49405 >2013-12-09 06:00:48,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 126b364e >2013-12-09 06:00:48,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 126b364e >2013-12-09 06:00:48,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32175c31 >2013-12-09 06:00:49,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32175c31 >2013-12-09 06:00:54,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f7384ba >2013-12-09 06:00:54,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7f7384ba >2013-12-09 06:00:54,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 181a89a2 >2013-12-09 06:00:54,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 181a89a2 >2013-12-09 06:00:59,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4954b23f >2013-12-09 06:01:00,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4954b23f >2013-12-09 06:01:00,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f294da5 >2013-12-09 06:01:00,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f294da5 >2013-12-09 06:01:05,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a543c8e >2013-12-09 06:01:06,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: a543c8e >2013-12-09 06:01:06,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61bc5ce3 >2013-12-09 06:01:06,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61bc5ce3 >2013-12-09 06:01:11,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43aa3230 >2013-12-09 06:01:12,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 43aa3230 >2013-12-09 06:01:12,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38f8c76f >2013-12-09 06:01:12,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38f8c76f >2013-12-09 06:01:17,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7eb9fa3d >2013-12-09 06:01:17,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7eb9fa3d >2013-12-09 06:01:17,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9d85d0e >2013-12-09 06:01:18,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9d85d0e >2013-12-09 06:01:23,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 496d25ea >2013-12-09 06:01:23,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 496d25ea >2013-12-09 06:01:23,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b60f74f >2013-12-09 06:01:23,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b60f74f >2013-12-09 06:01:28,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5391fbb >2013-12-09 06:01:29,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5391fbb >2013-12-09 06:01:29,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58be9acd >2013-12-09 06:01:29,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58be9acd >2013-12-09 06:01:34,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58a65fd2 >2013-12-09 06:01:35,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 58a65fd2 >2013-12-09 06:01:35,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c7384a3 >2013-12-09 06:01:35,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c7384a3 >2013-12-09 06:01:39,186 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-6) No up server in cluster >2013-12-09 06:01:39,186 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-6) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:01:39,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62d81dd5 >2013-12-09 06:01:39,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterTasksListVDSCommand, return: [], log id: 62d81dd5 >2013-12-09 06:01:40,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d46ef64 >2013-12-09 06:01:40,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: d46ef64 >2013-12-09 06:01:40,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f626633 >2013-12-09 06:01:41,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f626633 >2013-12-09 06:01:46,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2dc1d5c5 >2013-12-09 06:01:46,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2dc1d5c5 >2013-12-09 06:01:46,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a9d36e1 >2013-12-09 06:01:46,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a9d36e1 >2013-12-09 06:01:51,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5505e42b >2013-12-09 06:01:52,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5505e42b >2013-12-09 06:01:52,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 225ab977 >2013-12-09 06:01:52,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 225ab977 >2013-12-09 06:01:57,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52475216 >2013-12-09 06:01:58,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 52475216 >2013-12-09 06:01:58,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79bbc513 >2013-12-09 06:01:58,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79bbc513 >2013-12-09 06:02:03,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e99dd8 >2013-12-09 06:02:04,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: e99dd8 >2013-12-09 06:02:04,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73f63610 >2013-12-09 06:02:04,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73f63610 >2013-12-09 06:02:09,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d91c51f >2013-12-09 06:02:09,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d91c51f >2013-12-09 06:02:09,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 743e317f >2013-12-09 06:02:10,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 743e317f >2013-12-09 06:02:15,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1eec10d8 >2013-12-09 06:02:15,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1eec10d8 >2013-12-09 06:02:15,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c8b8820 >2013-12-09 06:02:15,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c8b8820 >2013-12-09 06:02:20,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ba0d25e >2013-12-09 06:02:21,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5ba0d25e >2013-12-09 06:02:21,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b0ae824 >2013-12-09 06:02:21,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b0ae824 >2013-12-09 06:02:26,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65d67cb1 >2013-12-09 06:02:27,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 65d67cb1 >2013-12-09 06:02:27,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30a2b66 >2013-12-09 06:02:27,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30a2b66 >2013-12-09 06:02:32,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d725093 >2013-12-09 06:02:32,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d725093 >2013-12-09 06:02:32,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f288cbb >2013-12-09 06:02:33,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f288cbb >2013-12-09 06:02:38,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 375635c1 >2013-12-09 06:02:38,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 375635c1 >2013-12-09 06:02:38,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f4a7854 >2013-12-09 06:02:38,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f4a7854 >2013-12-09 06:02:39,465 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-1) No up server in cluster >2013-12-09 06:02:39,465 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-1) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:02:39,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 623d3d41 >2013-12-09 06:02:39,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterTasksListVDSCommand, return: [], log id: 623d3d41 >2013-12-09 06:02:43,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70756c04 >2013-12-09 06:02:44,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 70756c04 >2013-12-09 06:02:44,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64b92e1d >2013-12-09 06:02:44,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64b92e1d >2013-12-09 06:02:49,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5381520 >2013-12-09 06:02:50,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5381520 >2013-12-09 06:02:50,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f93ae4b >2013-12-09 06:02:50,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f93ae4b >2013-12-09 06:02:55,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2589ca22 >2013-12-09 06:02:56,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2589ca22 >2013-12-09 06:02:56,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 607887f3 >2013-12-09 06:02:56,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 607887f3 >2013-12-09 06:03:01,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 426c1052 >2013-12-09 06:03:01,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 426c1052 >2013-12-09 06:03:01,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b5fc486 >2013-12-09 06:03:02,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b5fc486 >2013-12-09 06:03:07,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a8e2d76 >2013-12-09 06:03:07,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2a8e2d76 >2013-12-09 06:03:07,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26d83a5a >2013-12-09 06:03:07,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26d83a5a >2013-12-09 06:03:12,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57c1e2ce >2013-12-09 06:03:13,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 57c1e2ce >2013-12-09 06:03:13,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4cdb242f >2013-12-09 06:03:13,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4cdb242f >2013-12-09 06:03:18,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8c6ba94 >2013-12-09 06:03:19,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 8c6ba94 >2013-12-09 06:03:19,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14dc47eb >2013-12-09 06:03:19,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14dc47eb >2013-12-09 06:03:24,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7823740 >2013-12-09 06:03:24,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7823740 >2013-12-09 06:03:24,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 770c4cb4 >2013-12-09 06:03:25,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 770c4cb4 >2013-12-09 06:03:30,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a71d5d0 >2013-12-09 06:03:30,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: a71d5d0 >2013-12-09 06:03:30,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e97c68b >2013-12-09 06:03:30,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e97c68b >2013-12-09 06:03:35,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 179fe48f >2013-12-09 06:03:36,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 179fe48f >2013-12-09 06:03:36,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53546d1e >2013-12-09 06:03:36,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53546d1e >2013-12-09 06:03:39,738 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-90) No up server in cluster >2013-12-09 06:03:39,738 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-90) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:03:39,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: bd856a5 >2013-12-09 06:03:40,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterTasksListVDSCommand, return: [], log id: bd856a5 >2013-12-09 06:03:41,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d0533d2 >2013-12-09 06:03:42,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d0533d2 >2013-12-09 06:03:42,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 182de7d4 >2013-12-09 06:03:42,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 182de7d4 >2013-12-09 06:03:47,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ac47573 >2013-12-09 06:03:47,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ac47573 >2013-12-09 06:03:47,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c834dc3 >2013-12-09 06:03:48,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c834dc3 >2013-12-09 06:03:53,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b5015d0 >2013-12-09 06:03:53,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b5015d0 >2013-12-09 06:03:53,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c79a2ea >2013-12-09 06:03:53,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c79a2ea >2013-12-09 06:03:58,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71834e8d >2013-12-09 06:03:59,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 71834e8d >2013-12-09 06:03:59,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18e12603 >2013-12-09 06:03:59,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18e12603 >2013-12-09 06:04:04,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f27a3f0 >2013-12-09 06:04:05,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7f27a3f0 >2013-12-09 06:04:05,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a15d8a9 >2013-12-09 06:04:05,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a15d8a9 >2013-12-09 06:04:10,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b5b765b >2013-12-09 06:04:11,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b5b765b >2013-12-09 06:04:11,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 402e9c0c >2013-12-09 06:04:11,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 402e9c0c >2013-12-09 06:04:16,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5692b97d >2013-12-09 06:04:16,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5692b97d >2013-12-09 06:04:16,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 150715f2 >2013-12-09 06:04:17,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 150715f2 >2013-12-09 06:04:22,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 592ddee7 >2013-12-09 06:04:22,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 592ddee7 >2013-12-09 06:04:22,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a9e927b >2013-12-09 06:04:22,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a9e927b >2013-12-09 06:04:27,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6cf8e367 >2013-12-09 06:04:28,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6cf8e367 >2013-12-09 06:04:28,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f4107f2 >2013-12-09 06:04:28,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f4107f2 >2013-12-09 06:04:33,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5505d109 >2013-12-09 06:04:34,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5505d109 >2013-12-09 06:04:34,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12405e5b >2013-12-09 06:04:34,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12405e5b >2013-12-09 06:04:39,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26222690 >2013-12-09 06:04:39,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 26222690 >2013-12-09 06:04:39,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13527ec2 >2013-12-09 06:04:40,012 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-40) No up server in cluster >2013-12-09 06:04:40,012 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-40) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:04:40,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e8f53cd >2013-12-09 06:04:40,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13527ec2 >2013-12-09 06:04:40,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4e8f53cd >2013-12-09 06:04:45,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d05c08c >2013-12-09 06:04:45,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d05c08c >2013-12-09 06:04:45,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61aa00f4 >2013-12-09 06:04:45,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61aa00f4 >2013-12-09 06:04:50,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 358ce0a5 >2013-12-09 06:04:51,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 358ce0a5 >2013-12-09 06:04:51,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17c1990e >2013-12-09 06:04:51,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17c1990e >2013-12-09 06:04:56,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 416925d6 >2013-12-09 06:04:57,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 416925d6 >2013-12-09 06:04:57,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45734b76 >2013-12-09 06:04:57,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45734b76 >2013-12-09 06:05:02,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5270393f >2013-12-09 06:05:03,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5270393f >2013-12-09 06:05:03,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f102bba >2013-12-09 06:05:03,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f102bba >2013-12-09 06:05:08,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42a27ed >2013-12-09 06:05:08,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 42a27ed >2013-12-09 06:05:08,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 646b6fe7 >2013-12-09 06:05:09,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 646b6fe7 >2013-12-09 06:05:14,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 684af47 >2013-12-09 06:05:14,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 684af47 >2013-12-09 06:05:14,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59398987 >2013-12-09 06:05:14,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59398987 >2013-12-09 06:05:19,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d867017 >2013-12-09 06:05:20,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d867017 >2013-12-09 06:05:20,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 503fe798 >2013-12-09 06:05:20,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 503fe798 >2013-12-09 06:05:25,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2eda54f8 >2013-12-09 06:05:26,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2eda54f8 >2013-12-09 06:05:26,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63aa72e6 >2013-12-09 06:05:26,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63aa72e6 >2013-12-09 06:05:31,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 25e0864f >2013-12-09 06:05:31,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 25e0864f >2013-12-09 06:05:31,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4da4e792 >2013-12-09 06:05:32,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4da4e792 >2013-12-09 06:05:37,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d1253d3 >2013-12-09 06:05:37,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d1253d3 >2013-12-09 06:05:37,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d120640 >2013-12-09 06:05:37,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d120640 >2013-12-09 06:05:40,259 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-100) No up server in cluster >2013-12-09 06:05:40,259 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-100) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:05:40,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d602e40 >2013-12-09 06:05:40,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3d602e40 >2013-12-09 06:05:42,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11dabeb2 >2013-12-09 06:05:43,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 11dabeb2 >2013-12-09 06:05:43,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17f3577b >2013-12-09 06:05:43,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17f3577b >2013-12-09 06:05:48,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c12c8e9 >2013-12-09 06:05:49,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7c12c8e9 >2013-12-09 06:05:49,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 400ef0f8 >2013-12-09 06:05:49,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 400ef0f8 >2013-12-09 06:05:54,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51bec3d7 >2013-12-09 06:05:54,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 51bec3d7 >2013-12-09 06:05:54,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13e3dc7b >2013-12-09 06:05:55,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13e3dc7b >2013-12-09 06:06:00,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b4b924e >2013-12-09 06:06:00,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b4b924e >2013-12-09 06:06:00,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5873f5c2 >2013-12-09 06:06:01,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5873f5c2 >2013-12-09 06:06:06,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26fe6da7 >2013-12-09 06:06:06,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 26fe6da7 >2013-12-09 06:06:06,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56002e0e >2013-12-09 06:06:06,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56002e0e >2013-12-09 06:06:11,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26b149b8 >2013-12-09 06:06:12,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 26b149b8 >2013-12-09 06:06:12,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e847354 >2013-12-09 06:06:12,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e847354 >2013-12-09 06:06:17,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e892525 >2013-12-09 06:06:18,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2e892525 >2013-12-09 06:06:18,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e07e1f1 >2013-12-09 06:06:18,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e07e1f1 >2013-12-09 06:06:23,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ab18954 >2013-12-09 06:06:23,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1ab18954 >2013-12-09 06:06:23,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56717085 >2013-12-09 06:06:24,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56717085 >2013-12-09 06:06:29,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f8a9425 >2013-12-09 06:06:29,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f8a9425 >2013-12-09 06:06:29,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 925f27e >2013-12-09 06:06:29,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 925f27e >2013-12-09 06:06:34,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ebcabea >2013-12-09 06:06:35,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ebcabea >2013-12-09 06:06:35,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 571da770 >2013-12-09 06:06:35,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 571da770 >2013-12-09 06:06:40,536 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-52) No up server in cluster >2013-12-09 06:06:40,537 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-52) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:06:40,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77aa987c >2013-12-09 06:06:40,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36fbc7ad >2013-12-09 06:06:40,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterTasksListVDSCommand, return: [], log id: 77aa987c >2013-12-09 06:06:41,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 36fbc7ad >2013-12-09 06:06:41,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4eb6a644 >2013-12-09 06:06:41,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4eb6a644 >2013-12-09 06:06:46,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77bae89d >2013-12-09 06:06:47,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 77bae89d >2013-12-09 06:06:47,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4578c647 >2013-12-09 06:06:47,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4578c647 >2013-12-09 06:06:52,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 278b76f0 >2013-12-09 06:06:52,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 278b76f0 >2013-12-09 06:06:52,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36d59a4d >2013-12-09 06:06:53,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36d59a4d >2013-12-09 06:06:58,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33e70569 >2013-12-09 06:06:58,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 33e70569 >2013-12-09 06:06:58,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4dc746d6 >2013-12-09 06:06:58,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4dc746d6 >2013-12-09 06:07:03,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b53f491 >2013-12-09 06:07:04,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b53f491 >2013-12-09 06:07:04,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3153e79f >2013-12-09 06:07:04,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3153e79f >2013-12-09 06:07:09,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47f0c0e >2013-12-09 06:07:10,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 47f0c0e >2013-12-09 06:07:10,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1592b859 >2013-12-09 06:07:10,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1592b859 >2013-12-09 06:07:15,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 639c3b1a >2013-12-09 06:07:15,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 639c3b1a >2013-12-09 06:07:15,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36ad1149 >2013-12-09 06:07:16,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36ad1149 >2013-12-09 06:07:21,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6119acdd >2013-12-09 06:07:21,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6119acdd >2013-12-09 06:07:21,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f43eacc >2013-12-09 06:07:21,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f43eacc >2013-12-09 06:07:26,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: afe1005 >2013-12-09 06:07:27,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: afe1005 >2013-12-09 06:07:27,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67252e48 >2013-12-09 06:07:27,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67252e48 >2013-12-09 06:07:32,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6020fad7 >2013-12-09 06:07:33,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6020fad7 >2013-12-09 06:07:33,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a6ca55b >2013-12-09 06:07:33,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a6ca55b >2013-12-09 06:07:38,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75ea52c2 >2013-12-09 06:07:39,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 75ea52c2 >2013-12-09 06:07:39,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c6caff7 >2013-12-09 06:07:39,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c6caff7 >2013-12-09 06:07:40,821 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-70) No up server in cluster >2013-12-09 06:07:40,821 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-70) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:07:40,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18118f7c >2013-12-09 06:07:41,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterTasksListVDSCommand, return: [], log id: 18118f7c >2013-12-09 06:07:44,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 454a96ae >2013-12-09 06:07:44,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 454a96ae >2013-12-09 06:07:44,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c062c51 >2013-12-09 06:07:45,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c062c51 >2013-12-09 06:07:50,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13ff0dfe >2013-12-09 06:07:50,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 13ff0dfe >2013-12-09 06:07:50,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b57ebde >2013-12-09 06:07:50,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b57ebde >2013-12-09 06:07:55,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43961ad4 >2013-12-09 06:07:56,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 43961ad4 >2013-12-09 06:07:56,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4eeb05c7 >2013-12-09 06:07:56,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4eeb05c7 >2013-12-09 06:08:01,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2939f4ea >2013-12-09 06:08:02,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2939f4ea >2013-12-09 06:08:02,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d51c92b >2013-12-09 06:08:02,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d51c92b >2013-12-09 06:08:07,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f758ebf >2013-12-09 06:08:07,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f758ebf >2013-12-09 06:08:07,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 255a85d6 >2013-12-09 06:08:08,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 255a85d6 >2013-12-09 06:08:13,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13ecc2a4 >2013-12-09 06:08:13,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 13ecc2a4 >2013-12-09 06:08:13,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30f0c04d >2013-12-09 06:08:13,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30f0c04d >2013-12-09 06:08:19,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8f0984d >2013-12-09 06:08:19,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 8f0984d >2013-12-09 06:08:19,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: baf7256 >2013-12-09 06:08:19,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: baf7256 >2013-12-09 06:08:24,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d255070 >2013-12-09 06:08:25,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d255070 >2013-12-09 06:08:25,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c78fb42 >2013-12-09 06:08:25,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c78fb42 >2013-12-09 06:08:30,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1dddec73 >2013-12-09 06:08:31,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1dddec73 >2013-12-09 06:08:31,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e0881c1 >2013-12-09 06:08:31,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e0881c1 >2013-12-09 06:08:36,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 424f1c0c >2013-12-09 06:08:36,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 424f1c0c >2013-12-09 06:08:36,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32b1e8e0 >2013-12-09 06:08:37,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32b1e8e0 >2013-12-09 06:08:41,098 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-31) No up server in cluster >2013-12-09 06:08:41,098 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-31) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:08:41,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e190943 >2013-12-09 06:08:41,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2e190943 >2013-12-09 06:08:42,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 359c78b9 >2013-12-09 06:08:42,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 359c78b9 >2013-12-09 06:08:42,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19935e29 >2013-12-09 06:08:42,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19935e29 >2013-12-09 06:08:47,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13dfce72 >2013-12-09 06:08:48,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 13dfce72 >2013-12-09 06:08:48,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b2669a3 >2013-12-09 06:08:48,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b2669a3 >2013-12-09 06:08:53,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8bb1de5 >2013-12-09 06:08:54,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 8bb1de5 >2013-12-09 06:08:54,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39950440 >2013-12-09 06:08:54,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39950440 >2013-12-09 06:08:59,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 131d06bc >2013-12-09 06:08:59,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 131d06bc >2013-12-09 06:08:59,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 311f7447 >2013-12-09 06:09:00,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 311f7447 >2013-12-09 06:09:05,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ceab6e >2013-12-09 06:09:05,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ceab6e >2013-12-09 06:09:05,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 15da1033 >2013-12-09 06:09:05,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15da1033 >2013-12-09 06:09:10,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2baaecb4 >2013-12-09 06:09:11,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2baaecb4 >2013-12-09 06:09:11,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9519345 >2013-12-09 06:09:11,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9519345 >2013-12-09 06:09:16,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61b99e3d >2013-12-09 06:09:17,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 61b99e3d >2013-12-09 06:09:17,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 60b95691 >2013-12-09 06:09:17,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60b95691 >2013-12-09 06:09:22,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d47297d >2013-12-09 06:09:23,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d47297d >2013-12-09 06:09:23,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73681c67 >2013-12-09 06:09:23,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73681c67 >2013-12-09 06:09:28,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ba924d1 >2013-12-09 06:09:29,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2ba924d1 >2013-12-09 06:09:29,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 534ba601 >2013-12-09 06:09:29,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 534ba601 >2013-12-09 06:09:34,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5050b4ee >2013-12-09 06:09:35,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5050b4ee >2013-12-09 06:09:35,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40a415e6 >2013-12-09 06:09:35,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40a415e6 >2013-12-09 06:09:40,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53c77d51 >2013-12-09 06:09:40,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 53c77d51 >2013-12-09 06:09:41,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e28c648 >2013-12-09 06:09:41,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e28c648 >2013-12-09 06:09:41,388 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-73) No up server in cluster >2013-12-09 06:09:41,389 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-73) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:09:41,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a7d9dd6 >2013-12-09 06:09:41,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6a7d9dd6 >2013-12-09 06:09:46,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b2d0670 >2013-12-09 06:09:46,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: b2d0670 >2013-12-09 06:09:46,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 44e2da6c >2013-12-09 06:09:47,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44e2da6c >2013-12-09 06:09:52,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2751103d >2013-12-09 06:09:52,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2751103d >2013-12-09 06:09:52,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e7694a0 >2013-12-09 06:09:52,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e7694a0 >2013-12-09 06:09:57,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f6f3485 >2013-12-09 06:09:58,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3f6f3485 >2013-12-09 06:09:58,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c38b72 >2013-12-09 06:09:58,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c38b72 >2013-12-09 06:10:03,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f3ccf4e >2013-12-09 06:10:04,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f3ccf4e >2013-12-09 06:10:04,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bb731ad >2013-12-09 06:10:04,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bb731ad >2013-12-09 06:10:09,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e5b8757 >2013-12-09 06:10:09,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e5b8757 >2013-12-09 06:10:09,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b8791f9 >2013-12-09 06:10:10,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b8791f9 >2013-12-09 06:10:15,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3da9910 >2013-12-09 06:10:15,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3da9910 >2013-12-09 06:10:15,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e98055 >2013-12-09 06:10:15,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e98055 >2013-12-09 06:10:20,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5aacd3b8 >2013-12-09 06:10:21,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5aacd3b8 >2013-12-09 06:10:21,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6798495b >2013-12-09 06:10:21,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6798495b >2013-12-09 06:10:26,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f9595ad >2013-12-09 06:10:27,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f9595ad >2013-12-09 06:10:27,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f9743fa >2013-12-09 06:10:27,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f9743fa >2013-12-09 06:10:32,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 649d4ebb >2013-12-09 06:10:33,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 649d4ebb >2013-12-09 06:10:33,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7362c65f >2013-12-09 06:10:33,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7362c65f >2013-12-09 06:10:38,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b51e64d >2013-12-09 06:10:38,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b51e64d >2013-12-09 06:10:38,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26d3a259 >2013-12-09 06:10:39,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26d3a259 >2013-12-09 06:10:41,670 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-4) No up server in cluster >2013-12-09 06:10:41,671 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-4) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:10:41,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 634d116b >2013-12-09 06:10:41,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterTasksListVDSCommand, return: [], log id: 634d116b >2013-12-09 06:10:44,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7003dc6d >2013-12-09 06:10:44,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7003dc6d >2013-12-09 06:10:44,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a22206d >2013-12-09 06:10:44,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a22206d >2013-12-09 06:10:49,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e4e939e >2013-12-09 06:10:50,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e4e939e >2013-12-09 06:10:50,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 145a4312 >2013-12-09 06:10:50,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 145a4312 >2013-12-09 06:10:55,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c604fd9 >2013-12-09 06:10:56,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c604fd9 >2013-12-09 06:10:56,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26935102 >2013-12-09 06:10:56,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26935102 >2013-12-09 06:11:01,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6fbde6ae >2013-12-09 06:11:01,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6fbde6ae >2013-12-09 06:11:01,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4be2b7a6 >2013-12-09 06:11:02,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4be2b7a6 >2013-12-09 06:11:07,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d90dc36 >2013-12-09 06:11:07,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d90dc36 >2013-12-09 06:11:07,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f32241a >2013-12-09 06:11:07,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f32241a >2013-12-09 06:11:12,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d17c8bd >2013-12-09 06:11:13,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d17c8bd >2013-12-09 06:11:13,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d843976 >2013-12-09 06:11:13,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d843976 >2013-12-09 06:11:18,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d0272e2 >2013-12-09 06:11:19,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d0272e2 >2013-12-09 06:11:19,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d07565c >2013-12-09 06:11:19,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d07565c >2013-12-09 06:11:24,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1125c719 >2013-12-09 06:11:25,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1125c719 >2013-12-09 06:11:25,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6aa04f03 >2013-12-09 06:11:25,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6aa04f03 >2013-12-09 06:11:30,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4aa6a70c >2013-12-09 06:11:30,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4aa6a70c >2013-12-09 06:11:30,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c3305f1 >2013-12-09 06:11:31,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c3305f1 >2013-12-09 06:11:36,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b8c98dd >2013-12-09 06:11:36,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b8c98dd >2013-12-09 06:11:36,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75bb7e6b >2013-12-09 06:11:36,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75bb7e6b >2013-12-09 06:11:41,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 288aa7ac >2013-12-09 06:11:41,924 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-84) No up server in cluster >2013-12-09 06:11:41,924 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-84) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:11:41,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2eca1788 >2013-12-09 06:11:42,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2eca1788 >2013-12-09 06:11:42,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 288aa7ac >2013-12-09 06:11:42,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f75cf79 >2013-12-09 06:11:42,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f75cf79 >2013-12-09 06:11:47,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4da6fae2 >2013-12-09 06:11:48,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4da6fae2 >2013-12-09 06:11:48,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 681bbc6 >2013-12-09 06:11:48,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 681bbc6 >2013-12-09 06:11:53,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 60ff001e >2013-12-09 06:11:53,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 60ff001e >2013-12-09 06:11:53,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40f5dfd5 >2013-12-09 06:11:54,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40f5dfd5 >2013-12-09 06:11:59,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e12aa66 >2013-12-09 06:11:59,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e12aa66 >2013-12-09 06:11:59,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e3baecf >2013-12-09 06:12:00,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e3baecf >2013-12-09 06:12:05,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3132050d >2013-12-09 06:12:05,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3132050d >2013-12-09 06:12:05,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 96f4359 >2013-12-09 06:12:05,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 96f4359 >2013-12-09 06:12:10,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6dd41785 >2013-12-09 06:12:11,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6dd41785 >2013-12-09 06:12:11,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2405104e >2013-12-09 06:12:11,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2405104e >2013-12-09 06:12:16,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 25ae9007 >2013-12-09 06:12:17,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 25ae9007 >2013-12-09 06:12:17,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 387600ee >2013-12-09 06:12:17,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 387600ee >2013-12-09 06:12:22,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4734f624 >2013-12-09 06:12:22,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4734f624 >2013-12-09 06:12:22,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16567f6e >2013-12-09 06:12:23,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16567f6e >2013-12-09 06:12:28,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f1e61fb >2013-12-09 06:12:28,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: f1e61fb >2013-12-09 06:12:28,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40bdb93b >2013-12-09 06:12:28,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40bdb93b >2013-12-09 06:12:33,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23c200ff >2013-12-09 06:12:34,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 23c200ff >2013-12-09 06:12:34,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4284226a >2013-12-09 06:12:34,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4284226a >2013-12-09 06:12:39,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14f96139 >2013-12-09 06:12:40,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 14f96139 >2013-12-09 06:12:40,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: fa5dac1 >2013-12-09 06:12:40,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: fa5dac1 >2013-12-09 06:12:42,207 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) No up server in cluster >2013-12-09 06:12:42,207 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:12:42,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76fa299c >2013-12-09 06:12:42,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterTasksListVDSCommand, return: [], log id: 76fa299c >2013-12-09 06:12:45,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6408a945 >2013-12-09 06:12:45,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6408a945 >2013-12-09 06:12:45,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19f43995 >2013-12-09 06:12:46,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19f43995 >2013-12-09 06:12:51,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e3a7a25 >2013-12-09 06:12:51,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7e3a7a25 >2013-12-09 06:12:51,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 147b41de >2013-12-09 06:12:52,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 147b41de >2013-12-09 06:12:57,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b297600 >2013-12-09 06:12:57,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b297600 >2013-12-09 06:12:57,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d7a5a6d >2013-12-09 06:12:57,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d7a5a6d >2013-12-09 06:13:02,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37fd11a9 >2013-12-09 06:13:03,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 37fd11a9 >2013-12-09 06:13:03,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5efdf860 >2013-12-09 06:13:03,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5efdf860 >2013-12-09 06:13:08,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bf187e2 >2013-12-09 06:13:09,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1bf187e2 >2013-12-09 06:13:09,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72ddd58a >2013-12-09 06:13:09,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72ddd58a >2013-12-09 06:13:14,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1108671 >2013-12-09 06:13:14,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1108671 >2013-12-09 06:13:14,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c74ee2f >2013-12-09 06:13:15,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c74ee2f >2013-12-09 06:13:20,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c735ffd >2013-12-09 06:13:20,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c735ffd >2013-12-09 06:13:20,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ed40ba7 >2013-12-09 06:13:20,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ed40ba7 >2013-12-09 06:13:25,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5baff65 >2013-12-09 06:13:26,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5baff65 >2013-12-09 06:13:26,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3594afda >2013-12-09 06:13:26,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3594afda >2013-12-09 06:13:31,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37a3a16f >2013-12-09 06:13:32,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 37a3a16f >2013-12-09 06:13:32,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6284ed30 >2013-12-09 06:13:32,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6284ed30 >2013-12-09 06:13:37,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19a9ae57 >2013-12-09 06:13:38,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 19a9ae57 >2013-12-09 06:13:38,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 177b6e84 >2013-12-09 06:13:38,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 177b6e84 >2013-12-09 06:13:42,479 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-13) No up server in cluster >2013-12-09 06:13:42,479 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-13) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:13:42,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39707974 >2013-12-09 06:13:42,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterTasksListVDSCommand, return: [], log id: 39707974 >2013-12-09 06:13:43,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59712e70 >2013-12-09 06:13:43,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59712e70 >2013-12-09 06:13:43,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f1e8ce1 >2013-12-09 06:13:44,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f1e8ce1 >2013-12-09 06:13:49,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75b53d75 >2013-12-09 06:13:49,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 75b53d75 >2013-12-09 06:13:49,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44c0839e >2013-12-09 06:13:49,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44c0839e >2013-12-09 06:13:54,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2422e391 >2013-12-09 06:13:55,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2422e391 >2013-12-09 06:13:55,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3bb77418 >2013-12-09 06:13:55,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3bb77418 >2013-12-09 06:14:00,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b112eb2 >2013-12-09 06:14:01,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: b112eb2 >2013-12-09 06:14:01,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b45fb56 >2013-12-09 06:14:01,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b45fb56 >2013-12-09 06:14:06,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ca439aa >2013-12-09 06:14:06,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2ca439aa >2013-12-09 06:14:06,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 564678a0 >2013-12-09 06:14:07,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 564678a0 >2013-12-09 06:14:12,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a1d8083 >2013-12-09 06:14:12,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: a1d8083 >2013-12-09 06:14:12,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43421704 >2013-12-09 06:14:13,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43421704 >2013-12-09 06:14:18,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a98b26a >2013-12-09 06:14:18,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a98b26a >2013-12-09 06:14:18,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d7b5c4a >2013-12-09 06:14:18,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d7b5c4a >2013-12-09 06:14:23,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4897c1c6 >2013-12-09 06:14:24,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4897c1c6 >2013-12-09 06:14:24,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7bde5987 >2013-12-09 06:14:24,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7bde5987 >2013-12-09 06:14:29,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a951606 >2013-12-09 06:14:30,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3a951606 >2013-12-09 06:14:30,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61e29e18 >2013-12-09 06:14:30,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61e29e18 >2013-12-09 06:14:35,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e3cce6d >2013-12-09 06:14:35,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6e3cce6d >2013-12-09 06:14:35,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 471a624c >2013-12-09 06:14:36,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 471a624c >2013-12-09 06:14:41,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19616650 >2013-12-09 06:14:41,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19616650 >2013-12-09 06:14:41,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ade18d3 >2013-12-09 06:14:41,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ade18d3 >2013-12-09 06:14:42,760 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-65) No up server in cluster >2013-12-09 06:14:42,760 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-65) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:14:42,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 424f2502 >2013-12-09 06:14:43,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterTasksListVDSCommand, return: [], log id: 424f2502 >2013-12-09 06:14:46,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bac74a8 >2013-12-09 06:14:47,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1bac74a8 >2013-12-09 06:14:47,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 722f80df >2013-12-09 06:14:47,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 722f80df >2013-12-09 06:14:52,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72814f70 >2013-12-09 06:14:53,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 72814f70 >2013-12-09 06:14:53,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54e99611 >2013-12-09 06:14:53,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54e99611 >2013-12-09 06:14:58,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19e78469 >2013-12-09 06:14:58,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19e78469 >2013-12-09 06:14:58,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 232ee62f >2013-12-09 06:14:59,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 232ee62f >2013-12-09 06:15:04,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c9dbac7 >2013-12-09 06:15:04,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c9dbac7 >2013-12-09 06:15:04,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76a31803 >2013-12-09 06:15:04,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76a31803 >2013-12-09 06:15:09,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45ef9976 >2013-12-09 06:15:10,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 45ef9976 >2013-12-09 06:15:10,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 326d5e80 >2013-12-09 06:15:10,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 326d5e80 >2013-12-09 06:15:15,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2243d56a >2013-12-09 06:15:16,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2243d56a >2013-12-09 06:15:16,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7babd15a >2013-12-09 06:15:16,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7babd15a >2013-12-09 06:15:21,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e79c709 >2013-12-09 06:15:22,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e79c709 >2013-12-09 06:15:22,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6cd8832d >2013-12-09 06:15:22,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6cd8832d >2013-12-09 06:15:27,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31fec8b9 >2013-12-09 06:15:27,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 31fec8b9 >2013-12-09 06:15:27,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 49043260 >2013-12-09 06:15:28,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49043260 >2013-12-09 06:15:33,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76abc0e4 >2013-12-09 06:15:33,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 76abc0e4 >2013-12-09 06:15:33,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6093d15b >2013-12-09 06:15:33,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6093d15b >2013-12-09 06:15:38,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e738085 >2013-12-09 06:15:39,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2e738085 >2013-12-09 06:15:39,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6cd7cdbc >2013-12-09 06:15:39,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6cd7cdbc >2013-12-09 06:15:43,027 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) No up server in cluster >2013-12-09 06:15:43,027 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:15:43,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ad4d767 >2013-12-09 06:15:43,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1ad4d767 >2013-12-09 06:15:44,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4eb95911 >2013-12-09 06:15:45,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4eb95911 >2013-12-09 06:15:45,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 529d3f0a >2013-12-09 06:15:45,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 529d3f0a >2013-12-09 06:15:50,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57551445 >2013-12-09 06:15:50,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 57551445 >2013-12-09 06:15:50,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2de48f39 >2013-12-09 06:15:51,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2de48f39 >2013-12-09 06:15:56,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c92c8b1 >2013-12-09 06:15:56,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2c92c8b1 >2013-12-09 06:15:56,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 214a3a24 >2013-12-09 06:15:56,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 214a3a24 >2013-12-09 06:16:01,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3dec7ae7 >2013-12-09 06:16:02,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3dec7ae7 >2013-12-09 06:16:02,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 28e9c6d0 >2013-12-09 06:16:02,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28e9c6d0 >2013-12-09 06:16:07,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6db1ef6d >2013-12-09 06:16:08,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6db1ef6d >2013-12-09 06:16:08,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 399eb40b >2013-12-09 06:16:08,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 399eb40b >2013-12-09 06:16:13,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b915e85 >2013-12-09 06:16:14,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6b915e85 >2013-12-09 06:16:14,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64f27dbf >2013-12-09 06:16:14,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64f27dbf >2013-12-09 06:16:19,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e4e3a6d >2013-12-09 06:16:19,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6e4e3a6d >2013-12-09 06:16:19,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a259ad1 >2013-12-09 06:16:20,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a259ad1 >2013-12-09 06:16:25,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57ca37ad >2013-12-09 06:16:25,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 57ca37ad >2013-12-09 06:16:25,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7893f0d6 >2013-12-09 06:16:25,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7893f0d6 >2013-12-09 06:16:30,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d4617f1 >2013-12-09 06:16:31,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d4617f1 >2013-12-09 06:16:31,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d1ea59d >2013-12-09 06:16:31,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d1ea59d >2013-12-09 06:16:36,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7552598a >2013-12-09 06:16:37,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7552598a >2013-12-09 06:16:37,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24fcaea5 >2013-12-09 06:16:37,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24fcaea5 >2013-12-09 06:16:42,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68085dbc >2013-12-09 06:16:43,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 68085dbc >2013-12-09 06:16:43,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47ba5d30 >2013-12-09 06:16:43,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47ba5d30 >2013-12-09 06:16:43,311 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-47) No up server in cluster >2013-12-09 06:16:43,311 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-47) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:16:43,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4423b48a >2013-12-09 06:16:43,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4423b48a >2013-12-09 06:16:48,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c620a99 >2013-12-09 06:16:48,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1c620a99 >2013-12-09 06:16:48,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5bdf9e24 >2013-12-09 06:16:49,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5bdf9e24 >2013-12-09 06:16:54,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 571f8104 >2013-12-09 06:16:54,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 571f8104 >2013-12-09 06:16:54,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b26468b >2013-12-09 06:16:54,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b26468b >2013-12-09 06:16:59,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ea10ed5 >2013-12-09 06:17:00,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ea10ed5 >2013-12-09 06:17:00,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 779f46da >2013-12-09 06:17:00,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 779f46da >2013-12-09 06:17:05,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3fb13aee >2013-12-09 06:17:06,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3fb13aee >2013-12-09 06:17:06,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b3ad397 >2013-12-09 06:17:06,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b3ad397 >2013-12-09 06:17:11,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c95fa78 >2013-12-09 06:17:12,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c95fa78 >2013-12-09 06:17:12,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4aeb8d9 >2013-12-09 06:17:12,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4aeb8d9 >2013-12-09 06:17:17,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6abb7b8d >2013-12-09 06:17:17,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6abb7b8d >2013-12-09 06:17:17,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d696e13 >2013-12-09 06:17:18,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d696e13 >2013-12-09 06:17:23,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11db8207 >2013-12-09 06:17:23,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 11db8207 >2013-12-09 06:17:23,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b3b2cd5 >2013-12-09 06:17:23,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b3b2cd5 >2013-12-09 06:17:28,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a7b42ed >2013-12-09 06:17:29,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2a7b42ed >2013-12-09 06:17:29,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b833abe >2013-12-09 06:17:29,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b833abe >2013-12-09 06:17:34,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11da588d >2013-12-09 06:17:35,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 11da588d >2013-12-09 06:17:35,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e12b517 >2013-12-09 06:17:35,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e12b517 >2013-12-09 06:17:40,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30295bcf >2013-12-09 06:17:40,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 30295bcf >2013-12-09 06:17:40,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58800339 >2013-12-09 06:17:41,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58800339 >2013-12-09 06:17:43,587 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-68) No up server in cluster >2013-12-09 06:17:43,587 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-68) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:17:43,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a5405c5 >2013-12-09 06:17:43,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1a5405c5 >2013-12-09 06:17:46,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7014a4cc >2013-12-09 06:17:46,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7014a4cc >2013-12-09 06:17:46,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e92da43 >2013-12-09 06:17:46,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e92da43 >2013-12-09 06:17:51,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: fe67e67 >2013-12-09 06:17:52,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: fe67e67 >2013-12-09 06:17:52,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34a66042 >2013-12-09 06:17:52,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34a66042 >2013-12-09 06:17:57,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 329ea6be >2013-12-09 06:17:58,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 329ea6be >2013-12-09 06:17:58,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75b7b24 >2013-12-09 06:17:58,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75b7b24 >2013-12-09 06:18:03,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 560f53f >2013-12-09 06:18:03,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 560f53f >2013-12-09 06:18:03,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c61c85c >2013-12-09 06:18:04,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c61c85c >2013-12-09 06:18:09,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78cfdb2e >2013-12-09 06:18:09,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 78cfdb2e >2013-12-09 06:18:09,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f2f1331 >2013-12-09 06:18:10,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f2f1331 >2013-12-09 06:18:15,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29b0843f >2013-12-09 06:18:15,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 29b0843f >2013-12-09 06:18:15,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 747c4975 >2013-12-09 06:18:15,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 747c4975 >2013-12-09 06:18:20,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c95c393 >2013-12-09 06:18:21,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c95c393 >2013-12-09 06:18:21,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46db7d7f >2013-12-09 06:18:21,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46db7d7f >2013-12-09 06:18:26,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 471d30df >2013-12-09 06:18:27,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 471d30df >2013-12-09 06:18:27,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2dcabb6c >2013-12-09 06:18:27,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2dcabb6c >2013-12-09 06:18:32,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 723a4775 >2013-12-09 06:18:32,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 723a4775 >2013-12-09 06:18:32,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 595ddf22 >2013-12-09 06:18:33,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 595ddf22 >2013-12-09 06:18:38,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40e4c124 >2013-12-09 06:18:38,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 40e4c124 >2013-12-09 06:18:38,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b8a7aa9 >2013-12-09 06:18:38,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b8a7aa9 >2013-12-09 06:18:43,869 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-70) No up server in cluster >2013-12-09 06:18:43,869 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-70) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:18:43,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2553749d >2013-12-09 06:18:43,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62b4fe9f >2013-12-09 06:18:44,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2553749d >2013-12-09 06:18:44,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 62b4fe9f >2013-12-09 06:18:44,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5992e337 >2013-12-09 06:18:44,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5992e337 >2013-12-09 06:18:49,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13aff12d >2013-12-09 06:18:50,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 13aff12d >2013-12-09 06:18:50,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 44d32f4c >2013-12-09 06:18:50,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44d32f4c >2013-12-09 06:18:55,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7483a559 >2013-12-09 06:18:55,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7483a559 >2013-12-09 06:18:55,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5319d014 >2013-12-09 06:18:56,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5319d014 >2013-12-09 06:19:01,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5bfa9667 >2013-12-09 06:19:01,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5bfa9667 >2013-12-09 06:19:01,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25adacf7 >2013-12-09 06:19:01,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25adacf7 >2013-12-09 06:19:06,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5bcb3dbf >2013-12-09 06:19:07,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5bcb3dbf >2013-12-09 06:19:07,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76412157 >2013-12-09 06:19:07,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76412157 >2013-12-09 06:19:12,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7063c2e4 >2013-12-09 06:19:13,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7063c2e4 >2013-12-09 06:19:13,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c29f15d >2013-12-09 06:19:13,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c29f15d >2013-12-09 06:19:18,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 482f6ef7 >2013-12-09 06:19:19,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 482f6ef7 >2013-12-09 06:19:19,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1eb4d4a8 >2013-12-09 06:19:19,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1eb4d4a8 >2013-12-09 06:19:24,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e96e944 >2013-12-09 06:19:24,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e96e944 >2013-12-09 06:19:24,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3730b8b3 >2013-12-09 06:19:25,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3730b8b3 >2013-12-09 06:19:30,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6dd18277 >2013-12-09 06:19:30,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6dd18277 >2013-12-09 06:19:30,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19ef9936 >2013-12-09 06:19:30,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19ef9936 >2013-12-09 06:19:35,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 758e1164 >2013-12-09 06:19:36,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 758e1164 >2013-12-09 06:19:36,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21f18139 >2013-12-09 06:19:36,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21f18139 >2013-12-09 06:19:41,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c1bac3e >2013-12-09 06:19:42,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6c1bac3e >2013-12-09 06:19:42,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 768b4485 >2013-12-09 06:19:42,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 768b4485 >2013-12-09 06:19:44,129 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-78) No up server in cluster >2013-12-09 06:19:44,130 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-78) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:19:44,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38a487fe >2013-12-09 06:19:44,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterTasksListVDSCommand, return: [], log id: 38a487fe >2013-12-09 06:19:47,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73420143 >2013-12-09 06:19:47,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 73420143 >2013-12-09 06:19:47,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37fb9897 >2013-12-09 06:19:48,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37fb9897 >2013-12-09 06:19:53,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1669c1fd >2013-12-09 06:19:53,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1669c1fd >2013-12-09 06:19:53,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71c0333f >2013-12-09 06:19:53,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71c0333f >2013-12-09 06:19:58,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52472dee >2013-12-09 06:19:59,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 52472dee >2013-12-09 06:19:59,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65cbc7ae >2013-12-09 06:19:59,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65cbc7ae >2013-12-09 06:20:04,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b0e6c54 >2013-12-09 06:20:05,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5b0e6c54 >2013-12-09 06:20:05,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63f3fb84 >2013-12-09 06:20:05,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63f3fb84 >2013-12-09 06:20:10,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73e49140 >2013-12-09 06:20:11,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 73e49140 >2013-12-09 06:20:11,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2757b009 >2013-12-09 06:20:11,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2757b009 >2013-12-09 06:20:16,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 449fe72a >2013-12-09 06:20:16,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 449fe72a >2013-12-09 06:20:16,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c1c7ba >2013-12-09 06:20:17,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c1c7ba >2013-12-09 06:20:22,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b39c012 >2013-12-09 06:20:22,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b39c012 >2013-12-09 06:20:22,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5414a41d >2013-12-09 06:20:22,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5414a41d >2013-12-09 06:20:27,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4afd24fe >2013-12-09 06:20:28,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4afd24fe >2013-12-09 06:20:28,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d8787a7 >2013-12-09 06:20:28,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d8787a7 >2013-12-09 06:20:33,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f71d4d >2013-12-09 06:20:34,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f71d4d >2013-12-09 06:20:34,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53e28e1d >2013-12-09 06:20:34,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53e28e1d >2013-12-09 06:20:39,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73f0756d >2013-12-09 06:20:39,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 73f0756d >2013-12-09 06:20:39,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ab2505c >2013-12-09 06:20:40,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ab2505c >2013-12-09 06:20:44,418 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-44) No up server in cluster >2013-12-09 06:20:44,418 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-44) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:20:44,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f9070e2 >2013-12-09 06:20:44,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6f9070e2 >2013-12-09 06:20:45,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1294f65f >2013-12-09 06:20:45,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1294f65f >2013-12-09 06:20:45,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 782925e8 >2013-12-09 06:20:45,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 782925e8 >2013-12-09 06:20:50,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c325dbf >2013-12-09 06:20:51,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c325dbf >2013-12-09 06:20:51,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31e24fff >2013-12-09 06:20:51,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31e24fff >2013-12-09 06:20:56,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 852f9dd >2013-12-09 06:20:57,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 852f9dd >2013-12-09 06:20:57,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f63ecac >2013-12-09 06:20:57,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f63ecac >2013-12-09 06:21:02,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ffd456c >2013-12-09 06:21:03,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ffd456c >2013-12-09 06:21:03,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 658511 >2013-12-09 06:21:03,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 658511 >2013-12-09 06:21:08,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68b61805 >2013-12-09 06:21:08,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 68b61805 >2013-12-09 06:21:08,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f38c4a9 >2013-12-09 06:21:09,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f38c4a9 >2013-12-09 06:21:14,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6efba062 >2013-12-09 06:21:14,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6efba062 >2013-12-09 06:21:14,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16b5ad51 >2013-12-09 06:21:14,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16b5ad51 >2013-12-09 06:21:19,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74a028ac >2013-12-09 06:21:20,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 74a028ac >2013-12-09 06:21:20,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40142ac >2013-12-09 06:21:20,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40142ac >2013-12-09 06:21:25,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23c1490a >2013-12-09 06:21:26,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 23c1490a >2013-12-09 06:21:26,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 581aa2c2 >2013-12-09 06:21:26,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 581aa2c2 >2013-12-09 06:21:31,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5229b9ce >2013-12-09 06:21:31,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5229b9ce >2013-12-09 06:21:31,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74382dec >2013-12-09 06:21:32,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74382dec >2013-12-09 06:21:37,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d2b0e84 >2013-12-09 06:21:37,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d2b0e84 >2013-12-09 06:21:37,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6fbbd892 >2013-12-09 06:21:37,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6fbbd892 >2013-12-09 06:21:42,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3abce72a >2013-12-09 06:21:43,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3abce72a >2013-12-09 06:21:43,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 723d128c >2013-12-09 06:21:43,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 723d128c >2013-12-09 06:21:44,707 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-40) No up server in cluster >2013-12-09 06:21:44,707 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-40) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:21:44,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3194abdb >2013-12-09 06:21:44,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3194abdb >2013-12-09 06:21:48,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39ace339 >2013-12-09 06:21:49,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 39ace339 >2013-12-09 06:21:49,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f452ba2 >2013-12-09 06:21:49,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f452ba2 >2013-12-09 06:21:54,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 24728798 >2013-12-09 06:21:55,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 24728798 >2013-12-09 06:21:55,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ebbe58e >2013-12-09 06:21:55,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ebbe58e >2013-12-09 06:22:00,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69146217 >2013-12-09 06:22:00,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 69146217 >2013-12-09 06:22:00,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39a51551 >2013-12-09 06:22:01,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39a51551 >2013-12-09 06:22:06,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b91d096 >2013-12-09 06:22:06,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b91d096 >2013-12-09 06:22:06,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 22d87a67 >2013-12-09 06:22:06,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22d87a67 >2013-12-09 06:22:11,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28280aac >2013-12-09 06:22:12,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 28280aac >2013-12-09 06:22:12,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9dab753 >2013-12-09 06:22:12,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9dab753 >2013-12-09 06:22:17,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f185fe2 >2013-12-09 06:22:18,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1f185fe2 >2013-12-09 06:22:18,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53ace064 >2013-12-09 06:22:18,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53ace064 >2013-12-09 06:22:23,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7683710d >2013-12-09 06:22:23,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7683710d >2013-12-09 06:22:23,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19674468 >2013-12-09 06:22:24,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19674468 >2013-12-09 06:22:29,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5adf78f6 >2013-12-09 06:22:29,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5adf78f6 >2013-12-09 06:22:29,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 261810b1 >2013-12-09 06:22:29,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 261810b1 >2013-12-09 06:22:34,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5fe7c811 >2013-12-09 06:22:35,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5fe7c811 >2013-12-09 06:22:35,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 635fd14e >2013-12-09 06:22:35,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 635fd14e >2013-12-09 06:22:40,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3418ccdb >2013-12-09 06:22:41,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3418ccdb >2013-12-09 06:22:41,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48a6d9d9 >2013-12-09 06:22:41,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48a6d9d9 >2013-12-09 06:22:44,979 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-67) No up server in cluster >2013-12-09 06:22:44,979 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-67) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:22:44,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23f00f78 >2013-12-09 06:22:45,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterTasksListVDSCommand, return: [], log id: 23f00f78 >2013-12-09 06:22:46,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65d4f788 >2013-12-09 06:22:47,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 65d4f788 >2013-12-09 06:22:47,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f3b0e52 >2013-12-09 06:22:47,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f3b0e52 >2013-12-09 06:22:52,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1adc07a2 >2013-12-09 06:22:52,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1adc07a2 >2013-12-09 06:22:52,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b07f7bb >2013-12-09 06:22:53,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b07f7bb >2013-12-09 06:22:58,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ed12488 >2013-12-09 06:22:58,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6ed12488 >2013-12-09 06:22:58,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 551711da >2013-12-09 06:22:58,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 551711da >2013-12-09 06:23:03,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 28d1c7dd >2013-12-09 06:23:04,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 28d1c7dd >2013-12-09 06:23:04,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1cae49c2 >2013-12-09 06:23:04,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1cae49c2 >2013-12-09 06:23:09,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4043d768 >2013-12-09 06:23:10,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4043d768 >2013-12-09 06:23:10,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2eab03aa >2013-12-09 06:23:10,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2eab03aa >2013-12-09 06:23:15,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e8d9609 >2013-12-09 06:23:15,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e8d9609 >2013-12-09 06:23:15,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b078f51 >2013-12-09 06:23:16,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b078f51 >2013-12-09 06:23:21,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27c859f9 >2013-12-09 06:23:21,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 27c859f9 >2013-12-09 06:23:21,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 205e3194 >2013-12-09 06:23:21,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 205e3194 >2013-12-09 06:23:27,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e11c13f >2013-12-09 06:23:27,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: e11c13f >2013-12-09 06:23:27,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b58369d >2013-12-09 06:23:27,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b58369d >2013-12-09 06:23:32,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2842237e >2013-12-09 06:23:33,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2842237e >2013-12-09 06:23:33,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18cbb7fd >2013-12-09 06:23:33,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18cbb7fd >2013-12-09 06:23:38,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f2e0c85 >2013-12-09 06:23:39,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6f2e0c85 >2013-12-09 06:23:39,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 692b1e61 >2013-12-09 06:23:39,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 692b1e61 >2013-12-09 06:23:44,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 205109da >2013-12-09 06:23:44,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 205109da >2013-12-09 06:23:44,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 520f52f0 >2013-12-09 06:23:45,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 520f52f0 >2013-12-09 06:23:45,261 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-25) No up server in cluster >2013-12-09 06:23:45,261 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-25) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:23:45,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72b925f4 >2013-12-09 06:23:45,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterTasksListVDSCommand, return: [], log id: 72b925f4 >2013-12-09 06:23:50,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8ebf698 >2013-12-09 06:23:50,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 8ebf698 >2013-12-09 06:23:50,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 88a599a >2013-12-09 06:23:50,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 88a599a >2013-12-09 06:23:55,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 161eb2fb >2013-12-09 06:23:56,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 161eb2fb >2013-12-09 06:23:56,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c80a3f8 >2013-12-09 06:23:56,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c80a3f8 >2013-12-09 06:24:01,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ad98a18 >2013-12-09 06:24:02,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5ad98a18 >2013-12-09 06:24:02,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 252af6b4 >2013-12-09 06:24:02,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 252af6b4 >2013-12-09 06:24:07,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bdf2417 >2013-12-09 06:24:07,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1bdf2417 >2013-12-09 06:24:07,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 666e3f18 >2013-12-09 06:24:08,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 666e3f18 >2013-12-09 06:24:13,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1af43be1 >2013-12-09 06:24:13,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1af43be1 >2013-12-09 06:24:13,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78bb202c >2013-12-09 06:24:13,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78bb202c >2013-12-09 06:24:18,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8129914 >2013-12-09 06:24:19,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 8129914 >2013-12-09 06:24:19,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23e86463 >2013-12-09 06:24:19,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23e86463 >2013-12-09 06:24:24,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69c2d74b >2013-12-09 06:24:25,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 69c2d74b >2013-12-09 06:24:25,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6de96e9 >2013-12-09 06:24:25,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6de96e9 >2013-12-09 06:24:30,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f63afff >2013-12-09 06:24:31,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f63afff >2013-12-09 06:24:31,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2357d32d >2013-12-09 06:24:31,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2357d32d >2013-12-09 06:24:36,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 541ff172 >2013-12-09 06:24:36,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 541ff172 >2013-12-09 06:24:36,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 470ae583 >2013-12-09 06:24:37,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 470ae583 >2013-12-09 06:24:42,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7cd3f0c3 >2013-12-09 06:24:42,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7cd3f0c3 >2013-12-09 06:24:42,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 468e266f >2013-12-09 06:24:42,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 468e266f >2013-12-09 06:24:45,546 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-46) No up server in cluster >2013-12-09 06:24:45,546 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-46) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:24:45,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 201fa30f >2013-12-09 06:24:45,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterTasksListVDSCommand, return: [], log id: 201fa30f >2013-12-09 06:24:47,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72c3b360 >2013-12-09 06:24:48,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 72c3b360 >2013-12-09 06:24:48,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 86f733d >2013-12-09 06:24:48,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 86f733d >2013-12-09 06:24:53,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d532b93 >2013-12-09 06:24:54,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d532b93 >2013-12-09 06:24:54,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79474d45 >2013-12-09 06:24:54,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79474d45 >2013-12-09 06:24:59,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54c1228f >2013-12-09 06:24:59,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 54c1228f >2013-12-09 06:24:59,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 786d856d >2013-12-09 06:25:00,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 786d856d >2013-12-09 06:25:05,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19b3da0e >2013-12-09 06:25:05,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 19b3da0e >2013-12-09 06:25:05,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4708429f >2013-12-09 06:25:05,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4708429f >2013-12-09 06:25:11,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c85bd9 >2013-12-09 06:25:11,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c85bd9 >2013-12-09 06:25:11,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 60511996 >2013-12-09 06:25:11,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60511996 >2013-12-09 06:25:16,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74fb6d8d >2013-12-09 06:25:17,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 74fb6d8d >2013-12-09 06:25:17,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 248c2b8a >2013-12-09 06:25:17,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 248c2b8a >2013-12-09 06:25:22,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21ae29b4 >2013-12-09 06:25:23,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 21ae29b4 >2013-12-09 06:25:23,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5cd46e30 >2013-12-09 06:25:23,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cd46e30 >2013-12-09 06:25:28,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a606f7a >2013-12-09 06:25:28,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a606f7a >2013-12-09 06:25:28,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2560e5ee >2013-12-09 06:25:29,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2560e5ee >2013-12-09 06:25:34,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d0a8fa6 >2013-12-09 06:25:34,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d0a8fa6 >2013-12-09 06:25:34,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 709bb9f0 >2013-12-09 06:25:34,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 709bb9f0 >2013-12-09 06:25:39,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2475c964 >2013-12-09 06:25:40,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2475c964 >2013-12-09 06:25:40,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70b75c72 >2013-12-09 06:25:40,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70b75c72 >2013-12-09 06:25:45,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 424c238c >2013-12-09 06:25:45,816 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-37) No up server in cluster >2013-12-09 06:25:45,817 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-37) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:25:45,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35168aed >2013-12-09 06:25:46,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterTasksListVDSCommand, return: [], log id: 35168aed >2013-12-09 06:25:46,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 424c238c >2013-12-09 06:25:46,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 644ee8ba >2013-12-09 06:25:46,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 644ee8ba >2013-12-09 06:25:51,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12e89129 >2013-12-09 06:25:51,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 12e89129 >2013-12-09 06:25:51,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7128bee5 >2013-12-09 06:25:52,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7128bee5 >2013-12-09 06:25:57,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7648ba9b >2013-12-09 06:25:57,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7648ba9b >2013-12-09 06:25:57,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e9ca48b >2013-12-09 06:25:57,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e9ca48b >2013-12-09 06:26:02,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75474c7e >2013-12-09 06:26:03,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 75474c7e >2013-12-09 06:26:03,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63fa8a4e >2013-12-09 06:26:03,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63fa8a4e >2013-12-09 06:26:08,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 360e096e >2013-12-09 06:26:09,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 360e096e >2013-12-09 06:26:09,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20193c67 >2013-12-09 06:26:09,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20193c67 >2013-12-09 06:26:14,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 150e4cb2 >2013-12-09 06:26:15,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 150e4cb2 >2013-12-09 06:26:15,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42564a2e >2013-12-09 06:26:15,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42564a2e >2013-12-09 06:26:20,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b03e962 >2013-12-09 06:26:20,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3b03e962 >2013-12-09 06:26:20,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17c3fc72 >2013-12-09 06:26:21,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17c3fc72 >2013-12-09 06:26:26,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d70fc56 >2013-12-09 06:26:26,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d70fc56 >2013-12-09 06:26:26,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1973034a >2013-12-09 06:26:26,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1973034a >2013-12-09 06:26:31,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47e073b4 >2013-12-09 06:26:32,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 47e073b4 >2013-12-09 06:26:32,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 539a6f13 >2013-12-09 06:26:32,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 539a6f13 >2013-12-09 06:26:37,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 246e612c >2013-12-09 06:26:38,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 246e612c >2013-12-09 06:26:38,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f53739 >2013-12-09 06:26:38,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f53739 >2013-12-09 06:26:43,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d8312e9 >2013-12-09 06:26:43,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d8312e9 >2013-12-09 06:26:43,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74920097 >2013-12-09 06:26:44,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74920097 >2013-12-09 06:26:46,072 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-57) No up server in cluster >2013-12-09 06:26:46,072 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-57) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:26:46,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f234f37 >2013-12-09 06:26:46,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7f234f37 >2013-12-09 06:26:49,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e84ae4a >2013-12-09 06:26:49,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e84ae4a >2013-12-09 06:26:49,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 520adffa >2013-12-09 06:26:50,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 520adffa >2013-12-09 06:26:55,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ae29ab5 >2013-12-09 06:26:55,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7ae29ab5 >2013-12-09 06:26:55,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32637ebd >2013-12-09 06:26:55,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32637ebd >2013-12-09 06:27:00,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 732cdbea >2013-12-09 06:27:01,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 732cdbea >2013-12-09 06:27:01,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b7d172e >2013-12-09 06:27:01,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b7d172e >2013-12-09 06:27:06,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36c54d1c >2013-12-09 06:27:07,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 36c54d1c >2013-12-09 06:27:07,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c015a75 >2013-12-09 06:27:07,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c015a75 >2013-12-09 06:27:12,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53f06d08 >2013-12-09 06:27:12,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 53f06d08 >2013-12-09 06:27:12,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 166ce928 >2013-12-09 06:27:13,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 166ce928 >2013-12-09 06:27:18,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38015e60 >2013-12-09 06:27:18,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 38015e60 >2013-12-09 06:27:18,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bc09c00 >2013-12-09 06:27:18,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1bc09c00 >2013-12-09 06:27:23,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f95c71c >2013-12-09 06:27:24,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f95c71c >2013-12-09 06:27:24,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 405a0eb9 >2013-12-09 06:27:24,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 405a0eb9 >2013-12-09 06:27:29,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41f6f69b >2013-12-09 06:27:30,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 41f6f69b >2013-12-09 06:27:30,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7916b886 >2013-12-09 06:27:30,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7916b886 >2013-12-09 06:27:35,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37da8dd1 >2013-12-09 06:27:36,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 37da8dd1 >2013-12-09 06:27:36,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c0cad9b >2013-12-09 06:27:36,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c0cad9b >2013-12-09 06:27:41,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2282282f >2013-12-09 06:27:41,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2282282f >2013-12-09 06:27:41,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21240b6b >2013-12-09 06:27:42,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21240b6b >2013-12-09 06:27:46,366 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-80) No up server in cluster >2013-12-09 06:27:46,367 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-80) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:27:46,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6376bb3d >2013-12-09 06:27:46,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6376bb3d >2013-12-09 06:27:47,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3aecc9fb >2013-12-09 06:27:47,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3aecc9fb >2013-12-09 06:27:47,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c5e6b5f >2013-12-09 06:27:47,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c5e6b5f >2013-12-09 06:27:52,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5050a6c7 >2013-12-09 06:27:53,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5050a6c7 >2013-12-09 06:27:53,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e6b2af1 >2013-12-09 06:27:53,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e6b2af1 >2013-12-09 06:27:58,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 110a8def >2013-12-09 06:27:59,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 110a8def >2013-12-09 06:27:59,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 606e12ef >2013-12-09 06:27:59,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 606e12ef >2013-12-09 06:28:04,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 681feb32 >2013-12-09 06:28:04,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 681feb32 >2013-12-09 06:28:04,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2bae4865 >2013-12-09 06:28:05,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bae4865 >2013-12-09 06:28:10,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 132d2076 >2013-12-09 06:28:10,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 132d2076 >2013-12-09 06:28:10,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30992222 >2013-12-09 06:28:10,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30992222 >2013-12-09 06:28:15,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7773b8cb >2013-12-09 06:28:16,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7773b8cb >2013-12-09 06:28:16,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b80c32a >2013-12-09 06:28:16,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b80c32a >2013-12-09 06:28:21,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1727b088 >2013-12-09 06:28:22,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1727b088 >2013-12-09 06:28:22,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 481f1575 >2013-12-09 06:28:22,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 481f1575 >2013-12-09 06:28:27,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3bc2d4dd >2013-12-09 06:28:28,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3bc2d4dd >2013-12-09 06:28:28,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11982ce9 >2013-12-09 06:28:28,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11982ce9 >2013-12-09 06:28:33,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f3df41 >2013-12-09 06:28:33,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f3df41 >2013-12-09 06:28:33,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 723dacaa >2013-12-09 06:28:34,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 723dacaa >2013-12-09 06:28:39,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66cf7188 >2013-12-09 06:28:39,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 66cf7188 >2013-12-09 06:28:39,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d4a1ec7 >2013-12-09 06:28:39,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d4a1ec7 >2013-12-09 06:28:44,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4315a516 >2013-12-09 06:28:45,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4315a516 >2013-12-09 06:28:45,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ee31515 >2013-12-09 06:28:45,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ee31515 >2013-12-09 06:28:46,654 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-22) No up server in cluster >2013-12-09 06:28:46,654 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-22) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:28:46,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18f281fc >2013-12-09 06:28:46,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterTasksListVDSCommand, return: [], log id: 18f281fc >2013-12-09 06:28:50,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 449b5648 >2013-12-09 06:28:51,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 449b5648 >2013-12-09 06:28:51,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e526734 >2013-12-09 06:28:51,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e526734 >2013-12-09 06:28:56,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45d3b731 >2013-12-09 06:28:57,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 45d3b731 >2013-12-09 06:28:57,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33332ba8 >2013-12-09 06:28:57,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33332ba8 >2013-12-09 06:29:02,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51fbc5c6 >2013-12-09 06:29:02,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 51fbc5c6 >2013-12-09 06:29:02,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a605e2e >2013-12-09 06:29:03,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a605e2e >2013-12-09 06:29:08,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36bd22d6 >2013-12-09 06:29:08,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 36bd22d6 >2013-12-09 06:29:08,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69b0ccec >2013-12-09 06:29:08,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69b0ccec >2013-12-09 06:29:13,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 166530f9 >2013-12-09 06:29:14,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 166530f9 >2013-12-09 06:29:14,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a664d4 >2013-12-09 06:29:14,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a664d4 >2013-12-09 06:29:19,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: caee796 >2013-12-09 06:29:20,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: caee796 >2013-12-09 06:29:20,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e2cdbf1 >2013-12-09 06:29:20,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e2cdbf1 >2013-12-09 06:29:25,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31aa3204 >2013-12-09 06:29:25,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 31aa3204 >2013-12-09 06:29:25,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: dc24984 >2013-12-09 06:29:26,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: dc24984 >2013-12-09 06:29:31,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b887713 >2013-12-09 06:29:31,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b887713 >2013-12-09 06:29:31,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5858f304 >2013-12-09 06:29:31,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5858f304 >2013-12-09 06:29:37,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6759e0a2 >2013-12-09 06:29:37,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6759e0a2 >2013-12-09 06:29:37,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b3bb692 >2013-12-09 06:29:37,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b3bb692 >2013-12-09 06:29:42,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ed03e93 >2013-12-09 06:29:43,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3ed03e93 >2013-12-09 06:29:43,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b7f3550 >2013-12-09 06:29:43,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b7f3550 >2013-12-09 06:29:46,929 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-3) [6d1f044] No up server in cluster >2013-12-09 06:29:46,929 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-3) [6d1f044] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:29:46,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6993bf47 >2013-12-09 06:29:47,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterTasksListVDSCommand, return: [], log id: 6993bf47 >2013-12-09 06:29:48,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6cf13a5a >2013-12-09 06:29:49,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6cf13a5a >2013-12-09 06:29:49,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26f3d20e >2013-12-09 06:29:49,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26f3d20e >2013-12-09 06:29:54,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21d92020 >2013-12-09 06:29:54,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 21d92020 >2013-12-09 06:29:54,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ec03cc3 >2013-12-09 06:29:55,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ec03cc3 >2013-12-09 06:30:00,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1dcad15 >2013-12-09 06:30:00,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1dcad15 >2013-12-09 06:30:00,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2845ef08 >2013-12-09 06:30:00,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2845ef08 >2013-12-09 06:30:05,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4417ce24 >2013-12-09 06:30:06,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4417ce24 >2013-12-09 06:30:06,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6516f343 >2013-12-09 06:30:06,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6516f343 >2013-12-09 06:30:11,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37a9efa4 >2013-12-09 06:30:12,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 37a9efa4 >2013-12-09 06:30:12,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5af2f4b8 >2013-12-09 06:30:12,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5af2f4b8 >2013-12-09 06:30:17,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a0702ef >2013-12-09 06:30:17,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a0702ef >2013-12-09 06:30:17,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d5dff29 >2013-12-09 06:30:18,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d5dff29 >2013-12-09 06:30:23,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b1dc098 >2013-12-09 06:30:23,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b1dc098 >2013-12-09 06:30:23,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e2ab419 >2013-12-09 06:30:24,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e2ab419 >2013-12-09 06:30:29,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53386e73 >2013-12-09 06:30:29,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 53386e73 >2013-12-09 06:30:29,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3121902 >2013-12-09 06:30:29,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3121902 >2013-12-09 06:30:34,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 594a5c1e >2013-12-09 06:30:35,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 594a5c1e >2013-12-09 06:30:35,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 255e9057 >2013-12-09 06:30:35,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 255e9057 >2013-12-09 06:30:40,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 340decae >2013-12-09 06:30:41,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 340decae >2013-12-09 06:30:41,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12028df7 >2013-12-09 06:30:41,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12028df7 >2013-12-09 06:30:46,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3696930b >2013-12-09 06:30:46,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3696930b >2013-12-09 06:30:46,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48a855c5 >2013-12-09 06:30:47,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48a855c5 >2013-12-09 06:30:47,209 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-92) No up server in cluster >2013-12-09 06:30:47,209 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-92) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:30:47,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 355ab682 >2013-12-09 06:30:47,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterTasksListVDSCommand, return: [], log id: 355ab682 >2013-12-09 06:30:52,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 472c241c >2013-12-09 06:30:52,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 472c241c >2013-12-09 06:30:52,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 109f7663 >2013-12-09 06:30:52,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 109f7663 >2013-12-09 06:30:57,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48013fbe >2013-12-09 06:30:58,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 48013fbe >2013-12-09 06:30:58,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1864916e >2013-12-09 06:30:58,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1864916e >2013-12-09 06:31:03,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25f2cd9 >2013-12-09 06:31:04,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 25f2cd9 >2013-12-09 06:31:04,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f8f66fc >2013-12-09 06:31:04,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f8f66fc >2013-12-09 06:31:09,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41e05970 >2013-12-09 06:31:09,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 41e05970 >2013-12-09 06:31:09,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a04eaa3 >2013-12-09 06:31:10,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a04eaa3 >2013-12-09 06:31:15,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b6b019d >2013-12-09 06:31:15,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b6b019d >2013-12-09 06:31:15,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 422590f9 >2013-12-09 06:31:16,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 422590f9 >2013-12-09 06:31:21,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71601bf5 >2013-12-09 06:31:21,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 71601bf5 >2013-12-09 06:31:21,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5044dda2 >2013-12-09 06:31:21,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5044dda2 >2013-12-09 06:31:26,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2291acde >2013-12-09 06:31:27,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2291acde >2013-12-09 06:31:27,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35bd2f30 >2013-12-09 06:31:27,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35bd2f30 >2013-12-09 06:31:32,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5077118 >2013-12-09 06:31:33,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5077118 >2013-12-09 06:31:33,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4565d990 >2013-12-09 06:31:33,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4565d990 >2013-12-09 06:31:38,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d7d8e75 >2013-12-09 06:31:38,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d7d8e75 >2013-12-09 06:31:38,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b8ac989 >2013-12-09 06:31:39,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b8ac989 >2013-12-09 06:31:44,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c421f0c >2013-12-09 06:31:44,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c421f0c >2013-12-09 06:31:44,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 753fb7d4 >2013-12-09 06:31:44,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 753fb7d4 >2013-12-09 06:31:47,477 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-65) No up server in cluster >2013-12-09 06:31:47,478 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-65) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:31:47,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f68413f >2013-12-09 06:31:47,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5f68413f >2013-12-09 06:31:49,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1bfb4fe6 >2013-12-09 06:31:50,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1bfb4fe6 >2013-12-09 06:31:50,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b561f65 >2013-12-09 06:31:50,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b561f65 >2013-12-09 06:31:55,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74818d93 >2013-12-09 06:31:56,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 74818d93 >2013-12-09 06:31:56,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53f9cbe >2013-12-09 06:31:56,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53f9cbe >2013-12-09 06:32:01,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 145bf893 >2013-12-09 06:32:01,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 145bf893 >2013-12-09 06:32:01,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35bfa7d5 >2013-12-09 06:32:02,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35bfa7d5 >2013-12-09 06:32:07,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 567ba41e >2013-12-09 06:32:07,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 567ba41e >2013-12-09 06:32:07,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63765c35 >2013-12-09 06:32:08,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63765c35 >2013-12-09 06:32:13,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b45d410 >2013-12-09 06:32:13,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b45d410 >2013-12-09 06:32:13,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ae0e880 >2013-12-09 06:32:13,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ae0e880 >2013-12-09 06:32:18,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43252eb1 >2013-12-09 06:32:19,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 43252eb1 >2013-12-09 06:32:19,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36106a8b >2013-12-09 06:32:19,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36106a8b >2013-12-09 06:32:24,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 562db09e >2013-12-09 06:32:25,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 562db09e >2013-12-09 06:32:25,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 346a325a >2013-12-09 06:32:25,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 346a325a >2013-12-09 06:32:30,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 373a8bbf >2013-12-09 06:32:30,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 373a8bbf >2013-12-09 06:32:30,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4747c5f6 >2013-12-09 06:32:31,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4747c5f6 >2013-12-09 06:32:36,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f70f38c >2013-12-09 06:32:36,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f70f38c >2013-12-09 06:32:36,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d2f58e3 >2013-12-09 06:32:36,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d2f58e3 >2013-12-09 06:32:42,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b66f16c >2013-12-09 06:32:42,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1b66f16c >2013-12-09 06:32:42,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1216a5d9 >2013-12-09 06:32:42,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1216a5d9 >2013-12-09 06:32:47,768 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-48) No up server in cluster >2013-12-09 06:32:47,768 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-48) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:32:47,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5364a08 >2013-12-09 06:32:47,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b37a31c >2013-12-09 06:32:48,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5364a08 >2013-12-09 06:32:48,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b37a31c >2013-12-09 06:32:48,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b74d6ab >2013-12-09 06:32:48,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b74d6ab >2013-12-09 06:32:53,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 170a918f >2013-12-09 06:32:54,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 170a918f >2013-12-09 06:32:54,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66995da6 >2013-12-09 06:32:54,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66995da6 >2013-12-09 06:32:59,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19495af9 >2013-12-09 06:32:59,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 19495af9 >2013-12-09 06:32:59,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57adaa14 >2013-12-09 06:33:00,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57adaa14 >2013-12-09 06:33:05,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 126f12d2 >2013-12-09 06:33:05,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 126f12d2 >2013-12-09 06:33:05,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 576d398 >2013-12-09 06:33:05,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 576d398 >2013-12-09 06:33:10,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37548ef8 >2013-12-09 06:33:11,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 37548ef8 >2013-12-09 06:33:11,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 94263b6 >2013-12-09 06:33:11,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 94263b6 >2013-12-09 06:33:16,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d0ae838 >2013-12-09 06:33:17,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: d0ae838 >2013-12-09 06:33:17,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ff99325 >2013-12-09 06:33:17,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ff99325 >2013-12-09 06:33:22,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 399eb275 >2013-12-09 06:33:22,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 399eb275 >2013-12-09 06:33:22,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32445c65 >2013-12-09 06:33:23,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32445c65 >2013-12-09 06:33:28,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7effaf42 >2013-12-09 06:33:28,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7effaf42 >2013-12-09 06:33:28,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ca12fa7 >2013-12-09 06:33:29,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ca12fa7 >2013-12-09 06:33:34,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4485bf1 >2013-12-09 06:33:34,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4485bf1 >2013-12-09 06:33:34,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 711404b3 >2013-12-09 06:33:34,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 711404b3 >2013-12-09 06:33:39,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29a2544d >2013-12-09 06:33:40,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 29a2544d >2013-12-09 06:33:40,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 719c228e >2013-12-09 06:33:40,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 719c228e >2013-12-09 06:33:45,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9e02c74 >2013-12-09 06:33:46,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 9e02c74 >2013-12-09 06:33:46,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5fe76f80 >2013-12-09 06:33:46,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fe76f80 >2013-12-09 06:33:48,057 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-43) No up server in cluster >2013-12-09 06:33:48,057 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-43) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:33:48,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7994dd79 >2013-12-09 06:33:48,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7994dd79 >2013-12-09 06:33:51,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67918585 >2013-12-09 06:33:51,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 67918585 >2013-12-09 06:33:51,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29dd3d11 >2013-12-09 06:33:52,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29dd3d11 >2013-12-09 06:33:57,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75cffcda >2013-12-09 06:33:57,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 75cffcda >2013-12-09 06:33:57,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d20f8b9 >2013-12-09 06:33:57,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d20f8b9 >2013-12-09 06:34:02,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46920725 >2013-12-09 06:34:03,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 46920725 >2013-12-09 06:34:03,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ab2ea3e >2013-12-09 06:34:03,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ab2ea3e >2013-12-09 06:34:08,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5322a251 >2013-12-09 06:34:09,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5322a251 >2013-12-09 06:34:09,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c8cd06f >2013-12-09 06:34:09,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c8cd06f >2013-12-09 06:34:14,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32f102d6 >2013-12-09 06:34:14,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 32f102d6 >2013-12-09 06:34:14,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c1339df >2013-12-09 06:34:15,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c1339df >2013-12-09 06:34:20,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a9477ad >2013-12-09 06:34:20,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a9477ad >2013-12-09 06:34:20,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38edcca4 >2013-12-09 06:34:21,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38edcca4 >2013-12-09 06:34:26,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ff1eae1 >2013-12-09 06:34:26,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2ff1eae1 >2013-12-09 06:34:26,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f63819b >2013-12-09 06:34:26,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f63819b >2013-12-09 06:34:31,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6973afd0 >2013-12-09 06:34:32,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6973afd0 >2013-12-09 06:34:32,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a5bcec8 >2013-12-09 06:34:32,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a5bcec8 >2013-12-09 06:34:37,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1caa33 >2013-12-09 06:34:38,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1caa33 >2013-12-09 06:34:38,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63dcd16c >2013-12-09 06:34:38,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63dcd16c >2013-12-09 06:34:43,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 698bb337 >2013-12-09 06:34:43,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 698bb337 >2013-12-09 06:34:43,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61fc9725 >2013-12-09 06:34:44,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61fc9725 >2013-12-09 06:34:48,349 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-63) No up server in cluster >2013-12-09 06:34:48,349 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-63) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:34:48,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62aa5bb5 >2013-12-09 06:34:48,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterTasksListVDSCommand, return: [], log id: 62aa5bb5 >2013-12-09 06:34:49,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d823e53 >2013-12-09 06:34:49,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: d823e53 >2013-12-09 06:34:49,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61817e8a >2013-12-09 06:34:49,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61817e8a >2013-12-09 06:34:54,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43c00f4e >2013-12-09 06:34:55,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 43c00f4e >2013-12-09 06:34:55,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 304d310b >2013-12-09 06:34:55,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 304d310b >2013-12-09 06:35:00,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 122a4cbb >2013-12-09 06:35:01,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 122a4cbb >2013-12-09 06:35:01,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45b29a63 >2013-12-09 06:35:01,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45b29a63 >2013-12-09 06:35:06,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40e1081c >2013-12-09 06:35:06,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 40e1081c >2013-12-09 06:35:06,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a643876 >2013-12-09 06:35:07,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a643876 >2013-12-09 06:35:12,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a9c28a >2013-12-09 06:35:12,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a9c28a >2013-12-09 06:35:12,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d6f9d6b >2013-12-09 06:35:12,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d6f9d6b >2013-12-09 06:35:17,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21550d9 >2013-12-09 06:35:18,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 21550d9 >2013-12-09 06:35:18,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21a331d0 >2013-12-09 06:35:18,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21a331d0 >2013-12-09 06:35:23,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51608629 >2013-12-09 06:35:24,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 51608629 >2013-12-09 06:35:24,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49750177 >2013-12-09 06:35:24,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49750177 >2013-12-09 06:35:29,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1579133e >2013-12-09 06:35:30,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1579133e >2013-12-09 06:35:30,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25bc7573 >2013-12-09 06:35:30,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25bc7573 >2013-12-09 06:35:35,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 119fbe5a >2013-12-09 06:35:35,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 119fbe5a >2013-12-09 06:35:35,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 309566e1 >2013-12-09 06:35:36,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 309566e1 >2013-12-09 06:35:41,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3911dc69 >2013-12-09 06:35:41,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3911dc69 >2013-12-09 06:35:41,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b6db7ed >2013-12-09 06:35:41,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b6db7ed >2013-12-09 06:35:46,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e73f707 >2013-12-09 06:35:47,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: e73f707 >2013-12-09 06:35:47,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 420d6da1 >2013-12-09 06:35:47,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 420d6da1 >2013-12-09 06:35:48,620 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-56) No up server in cluster >2013-12-09 06:35:48,620 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-56) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:35:48,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a53ebd8 >2013-12-09 06:35:48,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2a53ebd8 >2013-12-09 06:35:52,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3166ae3e >2013-12-09 06:35:53,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3166ae3e >2013-12-09 06:35:53,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75552131 >2013-12-09 06:35:53,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75552131 >2013-12-09 06:35:58,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f58d50f >2013-12-09 06:35:58,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f58d50f >2013-12-09 06:35:58,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43e992ff >2013-12-09 06:35:59,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43e992ff >2013-12-09 06:36:04,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c012d01 >2013-12-09 06:36:04,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c012d01 >2013-12-09 06:36:04,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31a60a47 >2013-12-09 06:36:04,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31a60a47 >2013-12-09 06:36:09,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 390eb445 >2013-12-09 06:36:10,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 390eb445 >2013-12-09 06:36:10,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28c6151b >2013-12-09 06:36:10,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28c6151b >2013-12-09 06:36:15,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e5c1fec >2013-12-09 06:36:16,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6e5c1fec >2013-12-09 06:36:16,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 308c5968 >2013-12-09 06:36:16,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 308c5968 >2013-12-09 06:36:21,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32b902b1 >2013-12-09 06:36:21,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 32b902b1 >2013-12-09 06:36:21,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 557d927d >2013-12-09 06:36:22,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 557d927d >2013-12-09 06:36:27,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4cbfca4 >2013-12-09 06:36:27,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4cbfca4 >2013-12-09 06:36:27,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4de1ea9c >2013-12-09 06:36:28,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4de1ea9c >2013-12-09 06:36:33,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d9ddb99 >2013-12-09 06:36:33,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d9ddb99 >2013-12-09 06:36:33,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 489c266d >2013-12-09 06:36:33,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 489c266d >2013-12-09 06:36:38,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6fe51f34 >2013-12-09 06:36:39,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6fe51f34 >2013-12-09 06:36:39,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5cdc6f12 >2013-12-09 06:36:39,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cdc6f12 >2013-12-09 06:36:44,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6dadc6e8 >2013-12-09 06:36:45,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6dadc6e8 >2013-12-09 06:36:45,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2610a1fc >2013-12-09 06:36:45,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2610a1fc >2013-12-09 06:36:48,898 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-45) No up server in cluster >2013-12-09 06:36:48,898 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-45) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:36:48,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d04d093 >2013-12-09 06:36:49,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterTasksListVDSCommand, return: [], log id: d04d093 >2013-12-09 06:36:50,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e3ce5ea >2013-12-09 06:36:50,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e3ce5ea >2013-12-09 06:36:50,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 783ef237 >2013-12-09 06:36:51,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 783ef237 >2013-12-09 06:36:56,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23688c7b >2013-12-09 06:36:56,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 23688c7b >2013-12-09 06:36:56,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1588bebe >2013-12-09 06:36:56,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1588bebe >2013-12-09 06:37:01,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 553da995 >2013-12-09 06:37:02,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 553da995 >2013-12-09 06:37:02,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5052e358 >2013-12-09 06:37:02,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5052e358 >2013-12-09 06:37:07,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1913eaa7 >2013-12-09 06:37:08,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1913eaa7 >2013-12-09 06:37:08,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31cca957 >2013-12-09 06:37:08,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31cca957 >2013-12-09 06:37:13,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 555cbec1 >2013-12-09 06:37:14,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 555cbec1 >2013-12-09 06:37:14,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a4dff17 >2013-12-09 06:37:14,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a4dff17 >2013-12-09 06:37:19,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b820e00 >2013-12-09 06:37:19,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4b820e00 >2013-12-09 06:37:19,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 44da4307 >2013-12-09 06:37:20,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44da4307 >2013-12-09 06:37:25,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c9dfe51 >2013-12-09 06:37:25,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6c9dfe51 >2013-12-09 06:37:25,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1be8d2e1 >2013-12-09 06:37:25,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1be8d2e1 >2013-12-09 06:37:30,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31cb1800 >2013-12-09 06:37:31,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 31cb1800 >2013-12-09 06:37:31,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3500d633 >2013-12-09 06:37:31,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3500d633 >2013-12-09 06:37:36,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c4a0e66 >2013-12-09 06:37:37,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5c4a0e66 >2013-12-09 06:37:37,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71417ae2 >2013-12-09 06:37:37,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71417ae2 >2013-12-09 06:37:42,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c9676a6 >2013-12-09 06:37:42,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3c9676a6 >2013-12-09 06:37:42,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c49ced1 >2013-12-09 06:37:43,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c49ced1 >2013-12-09 06:37:48,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1fe6cd7d >2013-12-09 06:37:48,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1fe6cd7d >2013-12-09 06:37:48,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1473c3a3 >2013-12-09 06:37:49,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1473c3a3 >2013-12-09 06:37:49,192 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-18) No up server in cluster >2013-12-09 06:37:49,192 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-18) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:37:49,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 687fa9d8 >2013-12-09 06:37:49,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterTasksListVDSCommand, return: [], log id: 687fa9d8 >2013-12-09 06:37:54,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 356e7f41 >2013-12-09 06:37:54,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 356e7f41 >2013-12-09 06:37:54,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30fcd31e >2013-12-09 06:37:54,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30fcd31e >2013-12-09 06:37:59,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 502daf75 >2013-12-09 06:38:00,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 502daf75 >2013-12-09 06:38:00,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11a43af7 >2013-12-09 06:38:00,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11a43af7 >2013-12-09 06:38:05,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a98458 >2013-12-09 06:38:06,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7a98458 >2013-12-09 06:38:06,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b9798f5 >2013-12-09 06:38:06,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b9798f5 >2013-12-09 06:38:11,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 25b08b97 >2013-12-09 06:38:11,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 25b08b97 >2013-12-09 06:38:11,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 593ec5a8 >2013-12-09 06:38:12,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 593ec5a8 >2013-12-09 06:38:17,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38e8bc9f >2013-12-09 06:38:17,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 38e8bc9f >2013-12-09 06:38:17,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3500834a >2013-12-09 06:38:17,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3500834a >2013-12-09 06:38:22,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4affce7e >2013-12-09 06:38:23,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4affce7e >2013-12-09 06:38:23,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2efd0025 >2013-12-09 06:38:23,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2efd0025 >2013-12-09 06:38:28,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53a3a676 >2013-12-09 06:38:29,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 53a3a676 >2013-12-09 06:38:29,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2983abd >2013-12-09 06:38:29,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2983abd >2013-12-09 06:38:34,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e03b387 >2013-12-09 06:38:35,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3e03b387 >2013-12-09 06:38:35,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e38d42c >2013-12-09 06:38:35,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e38d42c >2013-12-09 06:38:40,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 782779e5 >2013-12-09 06:38:40,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 782779e5 >2013-12-09 06:38:40,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3bc9e7d2 >2013-12-09 06:38:41,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3bc9e7d2 >2013-12-09 06:38:46,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fec1d51 >2013-12-09 06:38:46,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2fec1d51 >2013-12-09 06:38:46,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 362900c0 >2013-12-09 06:38:46,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 362900c0 >2013-12-09 06:38:49,478 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) No up server in cluster >2013-12-09 06:38:49,478 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:38:49,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66114020 >2013-12-09 06:38:49,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterTasksListVDSCommand, return: [], log id: 66114020 >2013-12-09 06:38:51,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 535d2552 >2013-12-09 06:38:52,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 535d2552 >2013-12-09 06:38:52,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 276126f3 >2013-12-09 06:38:52,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 276126f3 >2013-12-09 06:38:57,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 836b2c6 >2013-12-09 06:38:58,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 836b2c6 >2013-12-09 06:38:58,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e6d0a8 >2013-12-09 06:38:58,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e6d0a8 >2013-12-09 06:39:03,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f56201d >2013-12-09 06:39:03,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f56201d >2013-12-09 06:39:03,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6dc5b3c0 >2013-12-09 06:39:04,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6dc5b3c0 >2013-12-09 06:39:09,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 415c2649 >2013-12-09 06:39:09,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 415c2649 >2013-12-09 06:39:09,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 695ab48d >2013-12-09 06:39:09,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 695ab48d >2013-12-09 06:39:14,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 335028eb >2013-12-09 06:39:15,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 335028eb >2013-12-09 06:39:15,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8b99814 >2013-12-09 06:39:15,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8b99814 >2013-12-09 06:39:20,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3690db25 >2013-12-09 06:39:21,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3690db25 >2013-12-09 06:39:21,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76b3154b >2013-12-09 06:39:21,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76b3154b >2013-12-09 06:39:26,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e47d8fb >2013-12-09 06:39:26,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7e47d8fb >2013-12-09 06:39:26,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ed4cb85 >2013-12-09 06:39:27,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ed4cb85 >2013-12-09 06:39:32,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ec7d2d3 >2013-12-09 06:39:32,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2ec7d2d3 >2013-12-09 06:39:32,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 14b6d10 >2013-12-09 06:39:33,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14b6d10 >2013-12-09 06:39:38,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ad6c4a9 >2013-12-09 06:39:38,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7ad6c4a9 >2013-12-09 06:39:38,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bc0dcf7 >2013-12-09 06:39:38,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4bc0dcf7 >2013-12-09 06:39:43,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68b553cd >2013-12-09 06:39:44,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 68b553cd >2013-12-09 06:39:44,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 300c286a >2013-12-09 06:39:44,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 300c286a >2013-12-09 06:39:49,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f1f5ff0 >2013-12-09 06:39:49,754 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-67) No up server in cluster >2013-12-09 06:39:49,754 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-67) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:39:49,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75d6daf5 >2013-12-09 06:39:50,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterTasksListVDSCommand, return: [], log id: 75d6daf5 >2013-12-09 06:39:50,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f1f5ff0 >2013-12-09 06:39:50,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72b8123f >2013-12-09 06:39:50,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72b8123f >2013-12-09 06:39:55,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65100c39 >2013-12-09 06:39:55,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 65100c39 >2013-12-09 06:39:55,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d8c871c >2013-12-09 06:39:56,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d8c871c >2013-12-09 06:40:01,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 635a797a >2013-12-09 06:40:01,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 635a797a >2013-12-09 06:40:01,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7cb1352 >2013-12-09 06:40:01,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7cb1352 >2013-12-09 06:40:06,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ad8fc17 >2013-12-09 06:40:07,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ad8fc17 >2013-12-09 06:40:07,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47f1ee3 >2013-12-09 06:40:07,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47f1ee3 >2013-12-09 06:40:12,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6aeb6030 >2013-12-09 06:40:13,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6aeb6030 >2013-12-09 06:40:13,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48efa06d >2013-12-09 06:40:13,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48efa06d >2013-12-09 06:40:18,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f219522 >2013-12-09 06:40:19,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5f219522 >2013-12-09 06:40:19,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54218219 >2013-12-09 06:40:19,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54218219 >2013-12-09 06:40:24,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38038cb5 >2013-12-09 06:40:24,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 38038cb5 >2013-12-09 06:40:24,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 629339af >2013-12-09 06:40:25,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 629339af >2013-12-09 06:40:30,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75cdef30 >2013-12-09 06:40:30,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 75cdef30 >2013-12-09 06:40:30,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f8a199f >2013-12-09 06:40:30,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f8a199f >2013-12-09 06:40:35,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ab0b520 >2013-12-09 06:40:36,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ab0b520 >2013-12-09 06:40:36,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b6d7651 >2013-12-09 06:40:36,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b6d7651 >2013-12-09 06:40:41,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a6ee43e >2013-12-09 06:40:42,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a6ee43e >2013-12-09 06:40:42,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d2a97f6 >2013-12-09 06:40:42,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d2a97f6 >2013-12-09 06:40:47,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 529d2212 >2013-12-09 06:40:47,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 529d2212 >2013-12-09 06:40:47,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17a43db2 >2013-12-09 06:40:48,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17a43db2 >2013-12-09 06:40:50,034 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-25) No up server in cluster >2013-12-09 06:40:50,034 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-25) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:40:50,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3af654f4 >2013-12-09 06:40:50,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3af654f4 >2013-12-09 06:40:53,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 177cd904 >2013-12-09 06:40:53,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 177cd904 >2013-12-09 06:40:53,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c7580b5 >2013-12-09 06:40:53,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c7580b5 >2013-12-09 06:40:58,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15cdfcc0 >2013-12-09 06:40:59,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 15cdfcc0 >2013-12-09 06:40:59,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bedb2b8 >2013-12-09 06:40:59,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4bedb2b8 >2013-12-09 06:41:04,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26dac146 >2013-12-09 06:41:05,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 26dac146 >2013-12-09 06:41:05,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e2159b >2013-12-09 06:41:05,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e2159b >2013-12-09 06:41:10,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 187ed2ac >2013-12-09 06:41:11,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 187ed2ac >2013-12-09 06:41:11,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39e2b639 >2013-12-09 06:41:11,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39e2b639 >2013-12-09 06:41:16,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58f27a3d >2013-12-09 06:41:16,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 58f27a3d >2013-12-09 06:41:16,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 80f1fa8 >2013-12-09 06:41:17,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 80f1fa8 >2013-12-09 06:41:22,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d332784 >2013-12-09 06:41:22,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d332784 >2013-12-09 06:41:22,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58adee1d >2013-12-09 06:41:22,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58adee1d >2013-12-09 06:41:27,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 695300fd >2013-12-09 06:41:28,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 695300fd >2013-12-09 06:41:28,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63a34dc1 >2013-12-09 06:41:28,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63a34dc1 >2013-12-09 06:41:33,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 682e416a >2013-12-09 06:41:34,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 682e416a >2013-12-09 06:41:34,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e37d477 >2013-12-09 06:41:34,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e37d477 >2013-12-09 06:41:39,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 15b1bb78 >2013-12-09 06:41:39,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 15b1bb78 >2013-12-09 06:41:39,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38ffeb26 >2013-12-09 06:41:40,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38ffeb26 >2013-12-09 06:41:45,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56154937 >2013-12-09 06:41:45,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 56154937 >2013-12-09 06:41:45,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23df9c7 >2013-12-09 06:41:45,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23df9c7 >2013-12-09 06:41:50,304 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-42) No up server in cluster >2013-12-09 06:41:50,305 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-42) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:41:50,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47364b96 >2013-12-09 06:41:50,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterTasksListVDSCommand, return: [], log id: 47364b96 >2013-12-09 06:41:50,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7aa468ab >2013-12-09 06:41:51,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7aa468ab >2013-12-09 06:41:51,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72442783 >2013-12-09 06:41:51,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72442783 >2013-12-09 06:41:56,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19dc5841 >2013-12-09 06:41:57,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 19dc5841 >2013-12-09 06:41:57,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11778cc9 >2013-12-09 06:41:57,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11778cc9 >2013-12-09 06:42:02,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 139ac45e >2013-12-09 06:42:02,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 139ac45e >2013-12-09 06:42:02,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23d08f25 >2013-12-09 06:42:03,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23d08f25 >2013-12-09 06:42:08,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d9bffe2 >2013-12-09 06:42:08,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d9bffe2 >2013-12-09 06:42:08,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35f6cda5 >2013-12-09 06:42:09,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35f6cda5 >2013-12-09 06:42:14,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40ef8f7c >2013-12-09 06:42:14,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 40ef8f7c >2013-12-09 06:42:14,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18144129 >2013-12-09 06:42:14,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18144129 >2013-12-09 06:42:19,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3bc70c19 >2013-12-09 06:42:20,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3bc70c19 >2013-12-09 06:42:20,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2075acf9 >2013-12-09 06:42:20,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2075acf9 >2013-12-09 06:42:25,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54cdd93e >2013-12-09 06:42:26,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 54cdd93e >2013-12-09 06:42:26,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64b5a36 >2013-12-09 06:42:26,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64b5a36 >2013-12-09 06:42:31,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5961fbd9 >2013-12-09 06:42:31,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5961fbd9 >2013-12-09 06:42:31,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73f7c4f4 >2013-12-09 06:42:32,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73f7c4f4 >2013-12-09 06:42:37,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4054b711 >2013-12-09 06:42:37,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4054b711 >2013-12-09 06:42:37,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 165c8503 >2013-12-09 06:42:38,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 165c8503 >2013-12-09 06:42:43,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62e507b9 >2013-12-09 06:42:43,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 62e507b9 >2013-12-09 06:42:43,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20f5dc98 >2013-12-09 06:42:43,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20f5dc98 >2013-12-09 06:42:48,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66896bf1 >2013-12-09 06:42:49,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 66896bf1 >2013-12-09 06:42:49,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a40615c >2013-12-09 06:42:49,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a40615c >2013-12-09 06:42:50,580 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-58) No up server in cluster >2013-12-09 06:42:50,580 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-58) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:42:50,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50b456c >2013-12-09 06:42:50,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterTasksListVDSCommand, return: [], log id: 50b456c >2013-12-09 06:42:54,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f2fcd08 >2013-12-09 06:42:55,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f2fcd08 >2013-12-09 06:42:55,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4edb3250 >2013-12-09 06:42:55,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4edb3250 >2013-12-09 06:43:00,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 680812ae >2013-12-09 06:43:00,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 680812ae >2013-12-09 06:43:00,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 256d258b >2013-12-09 06:43:01,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 256d258b >2013-12-09 06:43:06,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10b503f2 >2013-12-09 06:43:06,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 10b503f2 >2013-12-09 06:43:06,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b958661 >2013-12-09 06:43:06,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b958661 >2013-12-09 06:43:11,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ac8936a >2013-12-09 06:43:12,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7ac8936a >2013-12-09 06:43:12,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: db6cf49 >2013-12-09 06:43:12,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: db6cf49 >2013-12-09 06:43:17,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64b06bda >2013-12-09 06:43:18,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 64b06bda >2013-12-09 06:43:18,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b73cae9 >2013-12-09 06:43:18,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b73cae9 >2013-12-09 06:43:23,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16e315df >2013-12-09 06:43:23,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 16e315df >2013-12-09 06:43:23,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fe58221 >2013-12-09 06:43:24,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2fe58221 >2013-12-09 06:43:29,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a026dce >2013-12-09 06:43:29,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a026dce >2013-12-09 06:43:29,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a8bd72f >2013-12-09 06:43:29,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a8bd72f >2013-12-09 06:43:34,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 269c5f5b >2013-12-09 06:43:35,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 269c5f5b >2013-12-09 06:43:35,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e5d1df1 >2013-12-09 06:43:35,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e5d1df1 >2013-12-09 06:43:40,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e9780a >2013-12-09 06:43:41,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e9780a >2013-12-09 06:43:41,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f07e3ef >2013-12-09 06:43:41,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f07e3ef >2013-12-09 06:43:46,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75cd1631 >2013-12-09 06:43:47,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 75cd1631 >2013-12-09 06:43:47,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f880e19 >2013-12-09 06:43:47,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f880e19 >2013-12-09 06:43:50,868 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-8) No up server in cluster >2013-12-09 06:43:50,868 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-8) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:43:50,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77b42335 >2013-12-09 06:43:51,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterTasksListVDSCommand, return: [], log id: 77b42335 >2013-12-09 06:43:52,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62533713 >2013-12-09 06:43:52,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 62533713 >2013-12-09 06:43:52,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58f737d7 >2013-12-09 06:43:53,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58f737d7 >2013-12-09 06:43:58,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73758d5f >2013-12-09 06:43:58,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 73758d5f >2013-12-09 06:43:58,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36583d80 >2013-12-09 06:43:58,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36583d80 >2013-12-09 06:44:03,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f053666 >2013-12-09 06:44:04,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1f053666 >2013-12-09 06:44:04,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49c18cf9 >2013-12-09 06:44:04,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49c18cf9 >2013-12-09 06:44:09,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 279e2926 >2013-12-09 06:44:10,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 279e2926 >2013-12-09 06:44:10,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49a4378c >2013-12-09 06:44:10,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49a4378c >2013-12-09 06:44:15,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63d36db4 >2013-12-09 06:44:16,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 63d36db4 >2013-12-09 06:44:16,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29057478 >2013-12-09 06:44:16,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29057478 >2013-12-09 06:44:21,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7bfd78ff >2013-12-09 06:44:21,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7bfd78ff >2013-12-09 06:44:21,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1453846c >2013-12-09 06:44:22,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1453846c >2013-12-09 06:44:27,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 455edf92 >2013-12-09 06:44:27,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 455edf92 >2013-12-09 06:44:27,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31669ea7 >2013-12-09 06:44:27,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31669ea7 >2013-12-09 06:44:32,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26475a8a >2013-12-09 06:44:33,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 26475a8a >2013-12-09 06:44:33,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5cc9b64a >2013-12-09 06:44:33,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cc9b64a >2013-12-09 06:44:38,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 790163b9 >2013-12-09 06:44:39,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 790163b9 >2013-12-09 06:44:39,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d983b34 >2013-12-09 06:44:39,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d983b34 >2013-12-09 06:44:44,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e949580 >2013-12-09 06:44:44,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e949580 >2013-12-09 06:44:44,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 636e4c0a >2013-12-09 06:44:45,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 636e4c0a >2013-12-09 06:44:50,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 747ceb12 >2013-12-09 06:44:50,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 747ceb12 >2013-12-09 06:44:50,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5fa862ec >2013-12-09 06:44:51,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fa862ec >2013-12-09 06:44:51,151 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-35) No up server in cluster >2013-12-09 06:44:51,151 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-35) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:44:51,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 629ba439 >2013-12-09 06:44:51,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterTasksListVDSCommand, return: [], log id: 629ba439 >2013-12-09 06:44:56,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6906287f >2013-12-09 06:44:56,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6906287f >2013-12-09 06:44:56,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c027745 >2013-12-09 06:44:56,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c027745 >2013-12-09 06:45:01,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 543276f3 >2013-12-09 06:45:02,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 543276f3 >2013-12-09 06:45:02,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1468612a >2013-12-09 06:45:02,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1468612a >2013-12-09 06:45:07,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e3ec248 >2013-12-09 06:45:08,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3e3ec248 >2013-12-09 06:45:08,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c37aac7 >2013-12-09 06:45:08,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c37aac7 >2013-12-09 06:45:13,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f736840 >2013-12-09 06:45:13,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5f736840 >2013-12-09 06:45:13,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 658ef53e >2013-12-09 06:45:14,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 658ef53e >2013-12-09 06:45:19,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8334743 >2013-12-09 06:45:19,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 8334743 >2013-12-09 06:45:19,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c27e305 >2013-12-09 06:45:19,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c27e305 >2013-12-09 06:45:24,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6922fca8 >2013-12-09 06:45:25,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6922fca8 >2013-12-09 06:45:25,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c0630e5 >2013-12-09 06:45:25,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c0630e5 >2013-12-09 06:45:30,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 22615124 >2013-12-09 06:45:31,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 22615124 >2013-12-09 06:45:31,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33bc7f1b >2013-12-09 06:45:31,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33bc7f1b >2013-12-09 06:45:36,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2725b527 >2013-12-09 06:45:36,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2725b527 >2013-12-09 06:45:36,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fbf50c6 >2013-12-09 06:45:37,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2fbf50c6 >2013-12-09 06:45:42,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5bad32ff >2013-12-09 06:45:42,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5bad32ff >2013-12-09 06:45:42,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51f0d11a >2013-12-09 06:45:42,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51f0d11a >2013-12-09 06:45:48,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a03d063 >2013-12-09 06:45:48,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3a03d063 >2013-12-09 06:45:48,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58b48bdc >2013-12-09 06:45:48,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58b48bdc >2013-12-09 06:45:51,439 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-84) No up server in cluster >2013-12-09 06:45:51,439 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-84) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:45:51,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32d006dd >2013-12-09 06:45:51,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterTasksListVDSCommand, return: [], log id: 32d006dd >2013-12-09 06:45:53,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ec97fd6 >2013-12-09 06:45:54,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ec97fd6 >2013-12-09 06:45:54,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1571509 >2013-12-09 06:45:54,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1571509 >2013-12-09 06:45:59,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12854cf8 >2013-12-09 06:46:00,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 12854cf8 >2013-12-09 06:46:00,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35cb62e6 >2013-12-09 06:46:00,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35cb62e6 >2013-12-09 06:46:05,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6140e285 >2013-12-09 06:46:05,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6140e285 >2013-12-09 06:46:05,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f292700 >2013-12-09 06:46:06,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f292700 >2013-12-09 06:46:11,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59d5c415 >2013-12-09 06:46:11,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59d5c415 >2013-12-09 06:46:11,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10c82785 >2013-12-09 06:46:11,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10c82785 >2013-12-09 06:46:16,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e146876 >2013-12-09 06:46:17,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1e146876 >2013-12-09 06:46:17,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a36ad5f >2013-12-09 06:46:17,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a36ad5f >2013-12-09 06:46:22,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61e95aba >2013-12-09 06:46:23,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 61e95aba >2013-12-09 06:46:23,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6fa79efb >2013-12-09 06:46:23,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6fa79efb >2013-12-09 06:46:28,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20dd4755 >2013-12-09 06:46:28,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 20dd4755 >2013-12-09 06:46:28,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bd79d80 >2013-12-09 06:46:29,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bd79d80 >2013-12-09 06:46:34,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44abc374 >2013-12-09 06:46:34,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 44abc374 >2013-12-09 06:46:34,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 393747fb >2013-12-09 06:46:34,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 393747fb >2013-12-09 06:46:39,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e952195 >2013-12-09 06:46:40,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: e952195 >2013-12-09 06:46:40,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6729f1c2 >2013-12-09 06:46:40,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6729f1c2 >2013-12-09 06:46:45,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3da0235e >2013-12-09 06:46:46,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3da0235e >2013-12-09 06:46:46,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d89f367 >2013-12-09 06:46:46,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d89f367 >2013-12-09 06:46:51,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32237789 >2013-12-09 06:46:51,718 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-98) No up server in cluster >2013-12-09 06:46:51,719 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-98) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:46:51,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a3bd4f2 >2013-12-09 06:46:52,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3a3bd4f2 >2013-12-09 06:46:52,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 32237789 >2013-12-09 06:46:52,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4dff5c99 >2013-12-09 06:46:52,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4dff5c99 >2013-12-09 06:46:57,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49f4ffcf >2013-12-09 06:46:57,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 49f4ffcf >2013-12-09 06:46:57,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 716cb779 >2013-12-09 06:46:58,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 716cb779 >2013-12-09 06:47:03,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11b8ea6 >2013-12-09 06:47:03,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 11b8ea6 >2013-12-09 06:47:03,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 49ff3d9 >2013-12-09 06:47:03,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49ff3d9 >2013-12-09 06:47:08,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f7df3de >2013-12-09 06:47:09,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f7df3de >2013-12-09 06:47:09,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1cbd085 >2013-12-09 06:47:09,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1cbd085 >2013-12-09 06:47:14,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 311eddde >2013-12-09 06:47:15,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 311eddde >2013-12-09 06:47:15,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43e1d73d >2013-12-09 06:47:15,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43e1d73d >2013-12-09 06:47:20,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60c0c1d6 >2013-12-09 06:47:20,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 60c0c1d6 >2013-12-09 06:47:20,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 667d2975 >2013-12-09 06:47:21,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 667d2975 >2013-12-09 06:47:26,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f21a6f0 >2013-12-09 06:47:26,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3f21a6f0 >2013-12-09 06:47:26,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d24d9da >2013-12-09 06:47:26,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d24d9da >2013-12-09 06:47:32,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5305d1a1 >2013-12-09 06:47:32,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5305d1a1 >2013-12-09 06:47:32,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42af72bd >2013-12-09 06:47:32,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42af72bd >2013-12-09 06:47:37,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d1ea08 >2013-12-09 06:47:38,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4d1ea08 >2013-12-09 06:47:38,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9f8eb73 >2013-12-09 06:47:38,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9f8eb73 >2013-12-09 06:47:43,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b0ebcae >2013-12-09 06:47:44,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b0ebcae >2013-12-09 06:47:44,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3923d78a >2013-12-09 06:47:44,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3923d78a >2013-12-09 06:47:49,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 336fdf30 >2013-12-09 06:47:49,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 336fdf30 >2013-12-09 06:47:49,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32f6cbff >2013-12-09 06:47:50,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32f6cbff >2013-12-09 06:47:52,042 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-78) No up server in cluster >2013-12-09 06:47:52,042 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-78) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:47:52,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 214f2b96 >2013-12-09 06:47:52,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterTasksListVDSCommand, return: [], log id: 214f2b96 >2013-12-09 06:47:55,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77cec859 >2013-12-09 06:47:55,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 77cec859 >2013-12-09 06:47:55,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 150f2e30 >2013-12-09 06:47:55,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 150f2e30 >2013-12-09 06:48:00,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59bb60dd >2013-12-09 06:48:01,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 59bb60dd >2013-12-09 06:48:01,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 752c59f >2013-12-09 06:48:01,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 752c59f >2013-12-09 06:48:06,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b21a1d5 >2013-12-09 06:48:07,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6b21a1d5 >2013-12-09 06:48:07,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 492c3a76 >2013-12-09 06:48:07,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 492c3a76 >2013-12-09 06:48:12,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 720eccff >2013-12-09 06:48:12,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 720eccff >2013-12-09 06:48:12,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 509f8e14 >2013-12-09 06:48:13,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 509f8e14 >2013-12-09 06:48:18,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6164560e >2013-12-09 06:48:18,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6164560e >2013-12-09 06:48:18,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 142eb2a5 >2013-12-09 06:48:18,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 142eb2a5 >2013-12-09 06:48:23,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6bc2ff1e >2013-12-09 06:48:24,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6bc2ff1e >2013-12-09 06:48:24,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18da1de7 >2013-12-09 06:48:24,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18da1de7 >2013-12-09 06:48:29,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 22144f48 >2013-12-09 06:48:30,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 22144f48 >2013-12-09 06:48:30,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47092989 >2013-12-09 06:48:30,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47092989 >2013-12-09 06:48:35,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b5ccd53 >2013-12-09 06:48:35,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: b5ccd53 >2013-12-09 06:48:35,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e9e423 >2013-12-09 06:48:36,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e9e423 >2013-12-09 06:48:41,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2604d05e >2013-12-09 06:48:41,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2604d05e >2013-12-09 06:48:41,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5475556f >2013-12-09 06:48:41,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5475556f >2013-12-09 06:48:46,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ce03fb4 >2013-12-09 06:48:47,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ce03fb4 >2013-12-09 06:48:47,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a875bb >2013-12-09 06:48:47,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a875bb >2013-12-09 06:48:52,318 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-90) No up server in cluster >2013-12-09 06:48:52,319 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-90) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:48:52,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 940649d >2013-12-09 06:48:52,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterTasksListVDSCommand, return: [], log id: 940649d >2013-12-09 06:48:52,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7dcf99a2 >2013-12-09 06:48:53,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7dcf99a2 >2013-12-09 06:48:53,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4537f4c6 >2013-12-09 06:48:53,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4537f4c6 >2013-12-09 06:48:58,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 410ff845 >2013-12-09 06:48:59,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 410ff845 >2013-12-09 06:48:59,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2db2f837 >2013-12-09 06:48:59,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2db2f837 >2013-12-09 06:49:04,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3044ad42 >2013-12-09 06:49:04,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3044ad42 >2013-12-09 06:49:04,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70c2d78a >2013-12-09 06:49:05,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70c2d78a >2013-12-09 06:49:10,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bf52c97 >2013-12-09 06:49:10,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2bf52c97 >2013-12-09 06:49:10,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 24990002 >2013-12-09 06:49:10,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24990002 >2013-12-09 06:49:15,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59036c49 >2013-12-09 06:49:16,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59036c49 >2013-12-09 06:49:16,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74aff401 >2013-12-09 06:49:16,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74aff401 >2013-12-09 06:49:21,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b48f28a >2013-12-09 06:49:22,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b48f28a >2013-12-09 06:49:22,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 368ce473 >2013-12-09 06:49:22,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 368ce473 >2013-12-09 06:49:27,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d67e3a8 >2013-12-09 06:49:27,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d67e3a8 >2013-12-09 06:49:27,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f757414 >2013-12-09 06:49:28,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f757414 >2013-12-09 06:49:33,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3395902b >2013-12-09 06:49:33,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3395902b >2013-12-09 06:49:33,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11653bfd >2013-12-09 06:49:33,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11653bfd >2013-12-09 06:49:39,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 470b9b99 >2013-12-09 06:49:39,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 470b9b99 >2013-12-09 06:49:39,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 254f10f1 >2013-12-09 06:49:39,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 254f10f1 >2013-12-09 06:49:44,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7910a24a >2013-12-09 06:49:45,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7910a24a >2013-12-09 06:49:45,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5dfdc27e >2013-12-09 06:49:45,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5dfdc27e >2013-12-09 06:49:50,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a516745 >2013-12-09 06:49:51,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a516745 >2013-12-09 06:49:51,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fb88d18 >2013-12-09 06:49:51,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fb88d18 >2013-12-09 06:49:52,602 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-4) No up server in cluster >2013-12-09 06:49:52,602 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-4) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:49:52,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e6f0740 >2013-12-09 06:49:52,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6e6f0740 >2013-12-09 06:49:56,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e4c7f59 >2013-12-09 06:49:56,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4e4c7f59 >2013-12-09 06:49:56,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c3324ce >2013-12-09 06:49:57,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c3324ce >2013-12-09 06:50:02,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 309f04f0 >2013-12-09 06:50:02,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 309f04f0 >2013-12-09 06:50:02,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31a6028 >2013-12-09 06:50:03,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31a6028 >2013-12-09 06:50:08,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25cba6e2 >2013-12-09 06:50:08,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 25cba6e2 >2013-12-09 06:50:08,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 669a5563 >2013-12-09 06:50:08,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 669a5563 >2013-12-09 06:50:13,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37a392a4 >2013-12-09 06:50:14,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 37a392a4 >2013-12-09 06:50:14,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b8f091b >2013-12-09 06:50:14,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b8f091b >2013-12-09 06:50:19,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b47e6f9 >2013-12-09 06:50:20,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1b47e6f9 >2013-12-09 06:50:20,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12b033a4 >2013-12-09 06:50:20,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12b033a4 >2013-12-09 06:50:25,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62f0699e >2013-12-09 06:50:25,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 62f0699e >2013-12-09 06:50:25,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f83e6e2 >2013-12-09 06:50:26,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f83e6e2 >2013-12-09 06:50:31,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54c7f46b >2013-12-09 06:50:31,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 54c7f46b >2013-12-09 06:50:31,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40c0b875 >2013-12-09 06:50:31,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40c0b875 >2013-12-09 06:50:36,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73f70bc8 >2013-12-09 06:50:37,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 73f70bc8 >2013-12-09 06:50:37,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7347052f >2013-12-09 06:50:37,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7347052f >2013-12-09 06:50:42,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 554fab79 >2013-12-09 06:50:43,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 554fab79 >2013-12-09 06:50:43,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 584174b8 >2013-12-09 06:50:43,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 584174b8 >2013-12-09 06:50:48,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44413f42 >2013-12-09 06:50:49,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 44413f42 >2013-12-09 06:50:49,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b12d8e >2013-12-09 06:50:49,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b12d8e >2013-12-09 06:50:52,896 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-93) No up server in cluster >2013-12-09 06:50:52,896 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-93) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:50:52,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 377dac64 >2013-12-09 06:50:53,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterTasksListVDSCommand, return: [], log id: 377dac64 >2013-12-09 06:50:54,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10b5877b >2013-12-09 06:50:54,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 10b5877b >2013-12-09 06:50:54,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6421d918 >2013-12-09 06:50:55,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6421d918 >2013-12-09 06:51:00,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1982d2cb >2013-12-09 06:51:00,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1982d2cb >2013-12-09 06:51:00,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d4f7053 >2013-12-09 06:51:00,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d4f7053 >2013-12-09 06:51:05,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b9df1b0 >2013-12-09 06:51:06,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6b9df1b0 >2013-12-09 06:51:06,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f9f2e9d >2013-12-09 06:51:06,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f9f2e9d >2013-12-09 06:51:11,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3478eea2 >2013-12-09 06:51:12,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3478eea2 >2013-12-09 06:51:12,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: aedf94a >2013-12-09 06:51:12,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: aedf94a >2013-12-09 06:51:17,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6166d8e3 >2013-12-09 06:51:17,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6166d8e3 >2013-12-09 06:51:17,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38c934f6 >2013-12-09 06:51:18,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38c934f6 >2013-12-09 06:51:23,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a527e9a >2013-12-09 06:51:23,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4a527e9a >2013-12-09 06:51:23,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39582556 >2013-12-09 06:51:23,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39582556 >2013-12-09 06:51:28,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 787dddc9 >2013-12-09 06:51:29,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 787dddc9 >2013-12-09 06:51:29,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29b642f7 >2013-12-09 06:51:29,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29b642f7 >2013-12-09 06:51:34,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7df43a32 >2013-12-09 06:51:35,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7df43a32 >2013-12-09 06:51:35,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f20bc4b >2013-12-09 06:51:35,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f20bc4b >2013-12-09 06:51:40,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21da6a1f >2013-12-09 06:51:40,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 21da6a1f >2013-12-09 06:51:40,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 177443b0 >2013-12-09 06:51:41,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 177443b0 >2013-12-09 06:51:46,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67318f >2013-12-09 06:51:46,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 67318f >2013-12-09 06:51:46,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2041d100 >2013-12-09 06:51:47,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2041d100 >2013-12-09 06:51:52,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5da4cb19 >2013-12-09 06:51:52,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5da4cb19 >2013-12-09 06:51:52,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5048ada0 >2013-12-09 06:51:52,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5048ada0 >2013-12-09 06:51:53,167 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-28) No up server in cluster >2013-12-09 06:51:53,167 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-28) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:51:53,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67abea7d >2013-12-09 06:51:53,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterTasksListVDSCommand, return: [], log id: 67abea7d >2013-12-09 06:51:57,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8fd0d84 >2013-12-09 06:51:58,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 8fd0d84 >2013-12-09 06:51:58,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3549e7cb >2013-12-09 06:51:58,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3549e7cb >2013-12-09 06:52:03,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 283be3 >2013-12-09 06:52:04,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 283be3 >2013-12-09 06:52:04,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f9b2a82 >2013-12-09 06:52:04,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f9b2a82 >2013-12-09 06:52:09,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 628ca1c7 >2013-12-09 06:52:09,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 628ca1c7 >2013-12-09 06:52:09,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6148b08d >2013-12-09 06:52:10,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6148b08d >2013-12-09 06:52:15,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 787a2271 >2013-12-09 06:52:15,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 787a2271 >2013-12-09 06:52:15,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a608684 >2013-12-09 06:52:15,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a608684 >2013-12-09 06:52:20,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50a73897 >2013-12-09 06:52:21,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 50a73897 >2013-12-09 06:52:21,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c4d30fe >2013-12-09 06:52:21,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c4d30fe >2013-12-09 06:52:26,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44bb966b >2013-12-09 06:52:27,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 44bb966b >2013-12-09 06:52:27,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 749062ae >2013-12-09 06:52:27,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 749062ae >2013-12-09 06:52:32,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 22fa2654 >2013-12-09 06:52:32,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 22fa2654 >2013-12-09 06:52:32,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28583894 >2013-12-09 06:52:33,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28583894 >2013-12-09 06:52:38,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b0fffc3 >2013-12-09 06:52:38,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b0fffc3 >2013-12-09 06:52:38,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 755a6c42 >2013-12-09 06:52:39,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 755a6c42 >2013-12-09 06:52:44,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c212c8b >2013-12-09 06:52:44,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c212c8b >2013-12-09 06:52:44,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a1c96e2 >2013-12-09 06:52:44,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a1c96e2 >2013-12-09 06:52:49,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52223053 >2013-12-09 06:52:50,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 52223053 >2013-12-09 06:52:50,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27f4c27 >2013-12-09 06:52:50,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27f4c27 >2013-12-09 06:52:53,438 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-56) No up server in cluster >2013-12-09 06:52:53,438 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-56) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:52:53,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e32806b >2013-12-09 06:52:53,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3e32806b >2013-12-09 06:52:55,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e173461 >2013-12-09 06:52:56,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: e173461 >2013-12-09 06:52:56,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c1be613 >2013-12-09 06:52:56,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c1be613 >2013-12-09 06:53:01,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14a43fbb >2013-12-09 06:53:01,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 14a43fbb >2013-12-09 06:53:01,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a7d3da2 >2013-12-09 06:53:02,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a7d3da2 >2013-12-09 06:53:07,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39e2a8aa >2013-12-09 06:53:07,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 39e2a8aa >2013-12-09 06:53:07,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3cd2484a >2013-12-09 06:53:07,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3cd2484a >2013-12-09 06:53:12,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c7acb0b >2013-12-09 06:53:13,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5c7acb0b >2013-12-09 06:53:13,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4297e783 >2013-12-09 06:53:13,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4297e783 >2013-12-09 06:53:18,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79f47a63 >2013-12-09 06:53:19,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 79f47a63 >2013-12-09 06:53:19,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5edbeae5 >2013-12-09 06:53:19,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5edbeae5 >2013-12-09 06:53:24,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 808dbc0 >2013-12-09 06:53:25,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 808dbc0 >2013-12-09 06:53:25,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c9ba0ab >2013-12-09 06:53:25,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c9ba0ab >2013-12-09 06:53:30,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ad54edc >2013-12-09 06:53:30,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ad54edc >2013-12-09 06:53:30,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 684da771 >2013-12-09 06:53:31,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 684da771 >2013-12-09 06:53:36,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52275775 >2013-12-09 06:53:36,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 52275775 >2013-12-09 06:53:36,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9f0faab >2013-12-09 06:53:36,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9f0faab >2013-12-09 06:53:41,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: dd1e5d >2013-12-09 06:53:42,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: dd1e5d >2013-12-09 06:53:42,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 665e4389 >2013-12-09 06:53:42,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 665e4389 >2013-12-09 06:53:47,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1dc533cc >2013-12-09 06:53:48,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1dc533cc >2013-12-09 06:53:48,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 742f9e3a >2013-12-09 06:53:48,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 742f9e3a >2013-12-09 06:53:53,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7dd7f75d >2013-12-09 06:53:53,718 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-14) No up server in cluster >2013-12-09 06:53:53,718 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-14) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:53:53,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4888acb3 >2013-12-09 06:53:53,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7dd7f75d >2013-12-09 06:53:53,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31b25465 >2013-12-09 06:53:54,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4888acb3 >2013-12-09 06:53:54,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31b25465 >2013-12-09 06:53:59,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ab2c294 >2013-12-09 06:53:59,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5ab2c294 >2013-12-09 06:53:59,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a653f7f >2013-12-09 06:54:00,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a653f7f >2013-12-09 06:54:05,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7529b259 >2013-12-09 06:54:05,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7529b259 >2013-12-09 06:54:05,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71daedf0 >2013-12-09 06:54:05,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71daedf0 >2013-12-09 06:54:10,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56590b40 >2013-12-09 06:54:11,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 56590b40 >2013-12-09 06:54:11,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 22aacfb3 >2013-12-09 06:54:11,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22aacfb3 >2013-12-09 06:54:16,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2294adb7 >2013-12-09 06:54:17,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2294adb7 >2013-12-09 06:54:17,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33fda533 >2013-12-09 06:54:17,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33fda533 >2013-12-09 06:54:22,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c3fcccb >2013-12-09 06:54:22,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5c3fcccb >2013-12-09 06:54:22,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23a94a4c >2013-12-09 06:54:23,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23a94a4c >2013-12-09 06:54:28,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 536170e1 >2013-12-09 06:54:28,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 536170e1 >2013-12-09 06:54:28,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37dc60a6 >2013-12-09 06:54:28,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37dc60a6 >2013-12-09 06:54:33,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c75bcfd >2013-12-09 06:54:34,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: c75bcfd >2013-12-09 06:54:34,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f173911 >2013-12-09 06:54:34,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f173911 >2013-12-09 06:54:39,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a56b93e >2013-12-09 06:54:40,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2a56b93e >2013-12-09 06:54:40,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b284474 >2013-12-09 06:54:40,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b284474 >2013-12-09 06:54:45,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65c02580 >2013-12-09 06:54:46,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 65c02580 >2013-12-09 06:54:46,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bc49d68 >2013-12-09 06:54:46,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1bc49d68 >2013-12-09 06:54:51,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49e147e9 >2013-12-09 06:54:51,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 49e147e9 >2013-12-09 06:54:51,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32b64ff1 >2013-12-09 06:54:52,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32b64ff1 >2013-12-09 06:54:54,008 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-87) No up server in cluster >2013-12-09 06:54:54,008 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-87) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:54:54,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f63e111 >2013-12-09 06:54:54,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1f63e111 >2013-12-09 06:54:57,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18f83ae4 >2013-12-09 06:54:57,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 18f83ae4 >2013-12-09 06:54:57,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 418ca594 >2013-12-09 06:54:57,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 418ca594 >2013-12-09 06:55:02,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: dccacbb >2013-12-09 06:55:03,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: dccacbb >2013-12-09 06:55:03,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7af4d788 >2013-12-09 06:55:03,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7af4d788 >2013-12-09 06:55:08,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69c16028 >2013-12-09 06:55:09,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 69c16028 >2013-12-09 06:55:09,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35663933 >2013-12-09 06:55:09,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35663933 >2013-12-09 06:55:14,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 49606562 >2013-12-09 06:55:14,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 49606562 >2013-12-09 06:55:14,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58f1aab4 >2013-12-09 06:55:15,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58f1aab4 >2013-12-09 06:55:20,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f7fa58a >2013-12-09 06:55:20,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5f7fa58a >2013-12-09 06:55:20,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 49ef6123 >2013-12-09 06:55:20,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49ef6123 >2013-12-09 06:55:25,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54d0b56f >2013-12-09 06:55:26,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 54d0b56f >2013-12-09 06:55:26,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68ff0552 >2013-12-09 06:55:26,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68ff0552 >2013-12-09 06:55:31,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ab64928 >2013-12-09 06:55:32,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3ab64928 >2013-12-09 06:55:32,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e795492 >2013-12-09 06:55:32,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e795492 >2013-12-09 06:55:37,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 233245bf >2013-12-09 06:55:38,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 233245bf >2013-12-09 06:55:38,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7777cce2 >2013-12-09 06:55:38,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7777cce2 >2013-12-09 06:55:43,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ebee5bb >2013-12-09 06:55:43,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2ebee5bb >2013-12-09 06:55:43,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6fdf6b2a >2013-12-09 06:55:44,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6fdf6b2a >2013-12-09 06:55:49,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69cb83b7 >2013-12-09 06:55:49,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 69cb83b7 >2013-12-09 06:55:49,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55643ece >2013-12-09 06:55:49,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55643ece >2013-12-09 06:55:54,296 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-53) No up server in cluster >2013-12-09 06:55:54,296 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-53) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:55:54,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48f5191 >2013-12-09 06:55:54,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterTasksListVDSCommand, return: [], log id: 48f5191 >2013-12-09 06:55:54,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15c1745e >2013-12-09 06:55:55,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 15c1745e >2013-12-09 06:55:55,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37828246 >2013-12-09 06:55:55,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37828246 >2013-12-09 06:56:00,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: dc4f74f >2013-12-09 06:56:01,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: dc4f74f >2013-12-09 06:56:01,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 22706401 >2013-12-09 06:56:01,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22706401 >2013-12-09 06:56:06,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36f3784 >2013-12-09 06:56:06,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 36f3784 >2013-12-09 06:56:06,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35178eed >2013-12-09 06:56:07,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35178eed >2013-12-09 06:56:12,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b397a4b >2013-12-09 06:56:12,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b397a4b >2013-12-09 06:56:12,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64b146cf >2013-12-09 06:56:13,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64b146cf >2013-12-09 06:56:18,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57b20891 >2013-12-09 06:56:18,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 57b20891 >2013-12-09 06:56:18,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e8abaa1 >2013-12-09 06:56:18,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e8abaa1 >2013-12-09 06:56:23,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65b38937 >2013-12-09 06:56:24,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 65b38937 >2013-12-09 06:56:24,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c705c8f >2013-12-09 06:56:24,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c705c8f >2013-12-09 06:56:29,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67781d0c >2013-12-09 06:56:30,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 67781d0c >2013-12-09 06:56:30,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63116ee1 >2013-12-09 06:56:30,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63116ee1 >2013-12-09 06:56:35,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 445b9212 >2013-12-09 06:56:35,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 445b9212 >2013-12-09 06:56:35,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: fb0af3f >2013-12-09 06:56:36,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: fb0af3f >2013-12-09 06:56:41,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d6c9887 >2013-12-09 06:56:41,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d6c9887 >2013-12-09 06:56:41,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58c3a9c3 >2013-12-09 06:56:41,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58c3a9c3 >2013-12-09 06:56:46,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5eb527d7 >2013-12-09 06:56:47,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5eb527d7 >2013-12-09 06:56:47,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 205e1dff >2013-12-09 06:56:47,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 205e1dff >2013-12-09 06:56:52,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c79a1d4 >2013-12-09 06:56:53,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c79a1d4 >2013-12-09 06:56:53,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 498a8e03 >2013-12-09 06:56:53,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 498a8e03 >2013-12-09 06:56:54,598 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-32) No up server in cluster >2013-12-09 06:56:54,598 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-32) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:56:54,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 760ea753 >2013-12-09 06:56:54,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterTasksListVDSCommand, return: [], log id: 760ea753 >2013-12-09 06:56:58,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d85e6e5 >2013-12-09 06:56:59,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d85e6e5 >2013-12-09 06:56:59,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4603a6fc >2013-12-09 06:56:59,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4603a6fc >2013-12-09 06:57:04,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 582830de >2013-12-09 06:57:04,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 582830de >2013-12-09 06:57:04,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6eb3ac4f >2013-12-09 06:57:05,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6eb3ac4f >2013-12-09 06:57:10,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1111fbbb >2013-12-09 06:57:10,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1111fbbb >2013-12-09 06:57:10,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b183ae4 >2013-12-09 06:57:10,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b183ae4 >2013-12-09 06:57:15,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c89c612 >2013-12-09 06:57:16,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3c89c612 >2013-12-09 06:57:16,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56a6841d >2013-12-09 06:57:16,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56a6841d >2013-12-09 06:57:21,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f8f3bd4 >2013-12-09 06:57:22,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1f8f3bd4 >2013-12-09 06:57:22,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3853e8f7 >2013-12-09 06:57:22,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3853e8f7 >2013-12-09 06:57:27,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3312e2e1 >2013-12-09 06:57:27,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3312e2e1 >2013-12-09 06:57:27,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 471ac284 >2013-12-09 06:57:28,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 471ac284 >2013-12-09 06:57:33,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d824a78 >2013-12-09 06:57:33,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d824a78 >2013-12-09 06:57:33,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1cf3741 >2013-12-09 06:57:33,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1cf3741 >2013-12-09 06:57:38,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5651a6f8 >2013-12-09 06:57:39,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5651a6f8 >2013-12-09 06:57:39,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4cb99d57 >2013-12-09 06:57:39,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4cb99d57 >2013-12-09 06:57:44,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d167589 >2013-12-09 06:57:45,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d167589 >2013-12-09 06:57:45,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6946a875 >2013-12-09 06:57:45,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6946a875 >2013-12-09 06:57:50,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a650220 >2013-12-09 06:57:50,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4a650220 >2013-12-09 06:57:50,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: cd5276e >2013-12-09 06:57:51,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: cd5276e >2013-12-09 06:57:54,884 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-3) [6d1f044] No up server in cluster >2013-12-09 06:57:54,884 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-3) [6d1f044] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:57:54,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40dc172f >2013-12-09 06:57:55,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterTasksListVDSCommand, return: [], log id: 40dc172f >2013-12-09 06:57:56,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6081cc4a >2013-12-09 06:57:56,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6081cc4a >2013-12-09 06:57:56,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2dd7efbb >2013-12-09 06:57:56,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2dd7efbb >2013-12-09 06:58:01,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b62e723 >2013-12-09 06:58:02,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b62e723 >2013-12-09 06:58:02,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31796991 >2013-12-09 06:58:02,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31796991 >2013-12-09 06:58:07,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 600c4b6c >2013-12-09 06:58:08,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 600c4b6c >2013-12-09 06:58:08,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a05aa16 >2013-12-09 06:58:08,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a05aa16 >2013-12-09 06:58:13,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e3e07a6 >2013-12-09 06:58:14,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: e3e07a6 >2013-12-09 06:58:14,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 737f2413 >2013-12-09 06:58:14,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 737f2413 >2013-12-09 06:58:19,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42177af1 >2013-12-09 06:58:19,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42177af1 >2013-12-09 06:58:19,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46264317 >2013-12-09 06:58:20,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46264317 >2013-12-09 06:58:25,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16d72d0e >2013-12-09 06:58:25,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 16d72d0e >2013-12-09 06:58:25,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fbe158f >2013-12-09 06:58:25,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2fbe158f >2013-12-09 06:58:30,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e4d7d93 >2013-12-09 06:58:31,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2e4d7d93 >2013-12-09 06:58:31,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15b870cd >2013-12-09 06:58:31,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15b870cd >2013-12-09 06:58:36,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b13c255 >2013-12-09 06:58:37,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b13c255 >2013-12-09 06:58:37,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4878dbb0 >2013-12-09 06:58:37,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4878dbb0 >2013-12-09 06:58:42,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d0c4dd2 >2013-12-09 06:58:42,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5d0c4dd2 >2013-12-09 06:58:42,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d6b5b67 >2013-12-09 06:58:43,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d6b5b67 >2013-12-09 06:58:48,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59675a28 >2013-12-09 06:58:48,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59675a28 >2013-12-09 06:58:48,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2eaf6346 >2013-12-09 06:58:48,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2eaf6346 >2013-12-09 06:58:53,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 225c5a9b >2013-12-09 06:58:54,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 225c5a9b >2013-12-09 06:58:54,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f9b9056 >2013-12-09 06:58:54,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f9b9056 >2013-12-09 06:58:55,179 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-13) No up server in cluster >2013-12-09 06:58:55,179 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-13) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:58:55,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a9d85a8 >2013-12-09 06:58:55,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2a9d85a8 >2013-12-09 06:58:59,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ad920ad >2013-12-09 06:59:00,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7ad920ad >2013-12-09 06:59:00,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59f82b3a >2013-12-09 06:59:00,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59f82b3a >2013-12-09 06:59:05,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33ed9c6 >2013-12-09 06:59:06,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 33ed9c6 >2013-12-09 06:59:06,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b2a0d90 >2013-12-09 06:59:06,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b2a0d90 >2013-12-09 06:59:11,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f15803b >2013-12-09 06:59:11,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f15803b >2013-12-09 06:59:11,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c6094b4 >2013-12-09 06:59:12,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c6094b4 >2013-12-09 06:59:17,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5181105d >2013-12-09 06:59:17,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5181105d >2013-12-09 06:59:17,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ad5cd4a >2013-12-09 06:59:17,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ad5cd4a >2013-12-09 06:59:22,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18d449ac >2013-12-09 06:59:23,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 18d449ac >2013-12-09 06:59:23,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 666060e >2013-12-09 06:59:23,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 666060e >2013-12-09 06:59:28,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3266a038 >2013-12-09 06:59:29,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3266a038 >2013-12-09 06:59:29,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 14b37f22 >2013-12-09 06:59:29,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14b37f22 >2013-12-09 06:59:34,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6969ab73 >2013-12-09 06:59:34,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6969ab73 >2013-12-09 06:59:34,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8a9adeb >2013-12-09 06:59:35,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8a9adeb >2013-12-09 06:59:38,733 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-97) Attempting to update VMs/Templates Ovf. >2013-12-09 06:59:40,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-48) START, GlusterHooksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c288c7b >2013-12-09 06:59:40,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-49) START, GlusterHooksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30687e01 >2013-12-09 06:59:40,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-48) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@b0f1bf99, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@730c0703, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@c56afb64, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@93884ea3, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@6a39c00e, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@71e8c821, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@568c439], log id: 1c288c7b >2013-12-09 06:59:40,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-49) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@2fb8294d, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@6cfc3fd3, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@5c66abf, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@ac988070, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@eae195c, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@933515c3, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@7cbae589], log id: 30687e01 >2013-12-09 06:59:40,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3185f800 >2013-12-09 06:59:40,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3185f800 >2013-12-09 06:59:40,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b7599e0 >2013-12-09 06:59:41,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b7599e0 >2013-12-09 06:59:44,385 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-29) Start refreshing all users data >2013-12-09 06:59:46,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65aa4a59 >2013-12-09 06:59:46,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 65aa4a59 >2013-12-09 06:59:46,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c6c577e >2013-12-09 06:59:46,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c6c577e >2013-12-09 06:59:51,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36e6a63b >2013-12-09 06:59:52,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 36e6a63b >2013-12-09 06:59:52,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c15b3a7 >2013-12-09 06:59:52,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c15b3a7 >2013-12-09 06:59:55,458 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) No up server in cluster >2013-12-09 06:59:55,458 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 06:59:55,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18e09fd2 >2013-12-09 06:59:55,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterTasksListVDSCommand, return: [], log id: 18e09fd2 >2013-12-09 06:59:57,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5943e5ae >2013-12-09 06:59:58,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5943e5ae >2013-12-09 06:59:58,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41ea4edc >2013-12-09 06:59:58,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41ea4edc >2013-12-09 07:00:03,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bf04793 >2013-12-09 07:00:03,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2bf04793 >2013-12-09 07:00:03,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50a18317 >2013-12-09 07:00:04,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50a18317 >2013-12-09 07:00:09,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59823acf >2013-12-09 07:00:09,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 59823acf >2013-12-09 07:00:09,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3576ec6b >2013-12-09 07:00:09,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3576ec6b >2013-12-09 07:00:14,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d9fe0f6 >2013-12-09 07:00:15,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6d9fe0f6 >2013-12-09 07:00:15,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 529b081 >2013-12-09 07:00:15,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 529b081 >2013-12-09 07:00:20,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37cce327 >2013-12-09 07:00:21,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 37cce327 >2013-12-09 07:00:21,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 458e3663 >2013-12-09 07:00:21,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 458e3663 >2013-12-09 07:00:26,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f14d76d >2013-12-09 07:00:26,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f14d76d >2013-12-09 07:00:26,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55783459 >2013-12-09 07:00:27,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55783459 >2013-12-09 07:00:32,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7fbbf1f3 >2013-12-09 07:00:32,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7fbbf1f3 >2013-12-09 07:00:32,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 475ffa20 >2013-12-09 07:00:33,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 475ffa20 >2013-12-09 07:00:38,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62febb7d >2013-12-09 07:00:38,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 62febb7d >2013-12-09 07:00:38,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5528049b >2013-12-09 07:00:38,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5528049b >2013-12-09 07:00:43,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68902db1 >2013-12-09 07:00:44,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 68902db1 >2013-12-09 07:00:44,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 22b80c41 >2013-12-09 07:00:44,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22b80c41 >2013-12-09 07:00:49,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 455b0bec >2013-12-09 07:00:50,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 455b0bec >2013-12-09 07:00:50,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6095ca0d >2013-12-09 07:00:50,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6095ca0d >2013-12-09 07:00:55,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 28dc0cab >2013-12-09 07:00:55,738 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-86) No up server in cluster >2013-12-09 07:00:55,738 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-86) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:00:55,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b4de3ce >2013-12-09 07:00:55,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 28dc0cab >2013-12-09 07:00:55,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4251f521 >2013-12-09 07:00:56,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5b4de3ce >2013-12-09 07:00:56,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4251f521 >2013-12-09 07:01:01,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27d52ece >2013-12-09 07:01:01,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 27d52ece >2013-12-09 07:01:01,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 330d87f4 >2013-12-09 07:01:01,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 330d87f4 >2013-12-09 07:01:06,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d7ff381 >2013-12-09 07:01:07,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d7ff381 >2013-12-09 07:01:07,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1978a570 >2013-12-09 07:01:07,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1978a570 >2013-12-09 07:01:12,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79d8216f >2013-12-09 07:01:13,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 79d8216f >2013-12-09 07:01:13,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70bdccfe >2013-12-09 07:01:13,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70bdccfe >2013-12-09 07:01:18,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17671f19 >2013-12-09 07:01:19,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 17671f19 >2013-12-09 07:01:19,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6330de12 >2013-12-09 07:01:19,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6330de12 >2013-12-09 07:01:24,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69af7607 >2013-12-09 07:01:24,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 69af7607 >2013-12-09 07:01:24,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47e32832 >2013-12-09 07:01:25,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47e32832 >2013-12-09 07:01:30,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f076978 >2013-12-09 07:01:30,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f076978 >2013-12-09 07:01:30,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6524732a >2013-12-09 07:01:30,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6524732a >2013-12-09 07:01:35,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3eab7061 >2013-12-09 07:01:36,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3eab7061 >2013-12-09 07:01:36,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 570a016a >2013-12-09 07:01:36,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 570a016a >2013-12-09 07:01:41,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24b82783 >2013-12-09 07:01:42,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 24b82783 >2013-12-09 07:01:42,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43403051 >2013-12-09 07:01:42,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43403051 >2013-12-09 07:01:47,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46029a7 >2013-12-09 07:01:47,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 46029a7 >2013-12-09 07:01:47,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 25a6254f >2013-12-09 07:01:48,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25a6254f >2013-12-09 07:01:53,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d8bd5e6 >2013-12-09 07:01:53,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5d8bd5e6 >2013-12-09 07:01:53,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b2ecd59 >2013-12-09 07:01:54,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b2ecd59 >2013-12-09 07:01:56,020 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-61) No up server in cluster >2013-12-09 07:01:56,020 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-61) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:01:56,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28f8714a >2013-12-09 07:01:56,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterTasksListVDSCommand, return: [], log id: 28f8714a >2013-12-09 07:01:59,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43df3d51 >2013-12-09 07:01:59,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 43df3d51 >2013-12-09 07:01:59,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 156f38ad >2013-12-09 07:01:59,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 156f38ad >2013-12-09 07:02:04,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f69ba23 >2013-12-09 07:02:05,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3f69ba23 >2013-12-09 07:02:05,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7867152b >2013-12-09 07:02:05,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7867152b >2013-12-09 07:02:10,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a1cb708 >2013-12-09 07:02:11,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4a1cb708 >2013-12-09 07:02:11,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1810538d >2013-12-09 07:02:11,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1810538d >2013-12-09 07:02:16,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43dc30d5 >2013-12-09 07:02:16,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 43dc30d5 >2013-12-09 07:02:16,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64dfaddd >2013-12-09 07:02:17,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64dfaddd >2013-12-09 07:02:22,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 466fa50b >2013-12-09 07:02:22,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 466fa50b >2013-12-09 07:02:22,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6cbd0f15 >2013-12-09 07:02:22,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6cbd0f15 >2013-12-09 07:02:27,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 368ce034 >2013-12-09 07:02:28,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 368ce034 >2013-12-09 07:02:28,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7539e91e >2013-12-09 07:02:28,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7539e91e >2013-12-09 07:02:33,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a387518 >2013-12-09 07:02:34,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a387518 >2013-12-09 07:02:34,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c6d829b >2013-12-09 07:02:34,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c6d829b >2013-12-09 07:02:39,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19b91361 >2013-12-09 07:02:40,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 19b91361 >2013-12-09 07:02:40,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a275e2f >2013-12-09 07:02:40,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a275e2f >2013-12-09 07:02:45,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47476377 >2013-12-09 07:02:45,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 47476377 >2013-12-09 07:02:45,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59e27b20 >2013-12-09 07:02:46,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59e27b20 >2013-12-09 07:02:51,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27e37b2a >2013-12-09 07:02:51,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 27e37b2a >2013-12-09 07:02:51,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f894cf0 >2013-12-09 07:02:51,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f894cf0 >2013-12-09 07:02:56,298 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-32) No up server in cluster >2013-12-09 07:02:56,298 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-32) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:02:56,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e605890 >2013-12-09 07:02:56,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterTasksListVDSCommand, return: [], log id: e605890 >2013-12-09 07:02:56,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5fa5a138 >2013-12-09 07:02:57,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5fa5a138 >2013-12-09 07:02:57,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49ce928 >2013-12-09 07:02:57,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49ce928 >2013-12-09 07:03:02,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a6d0efb >2013-12-09 07:03:03,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1a6d0efb >2013-12-09 07:03:03,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 588ae0b >2013-12-09 07:03:03,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 588ae0b >2013-12-09 07:03:08,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a144a39 >2013-12-09 07:03:08,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: a144a39 >2013-12-09 07:03:08,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e32fe7b >2013-12-09 07:03:09,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e32fe7b >2013-12-09 07:03:14,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f1178ca >2013-12-09 07:03:14,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f1178ca >2013-12-09 07:03:14,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 618b0b05 >2013-12-09 07:03:14,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 618b0b05 >2013-12-09 07:03:19,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15ddc3a4 >2013-12-09 07:03:20,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 15ddc3a4 >2013-12-09 07:03:20,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19c811ff >2013-12-09 07:03:20,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19c811ff >2013-12-09 07:03:25,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35b7ae89 >2013-12-09 07:03:26,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 35b7ae89 >2013-12-09 07:03:26,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b104f04 >2013-12-09 07:03:26,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b104f04 >2013-12-09 07:03:31,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 277cd235 >2013-12-09 07:03:31,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 277cd235 >2013-12-09 07:03:31,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45b0b29f >2013-12-09 07:03:32,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45b0b29f >2013-12-09 07:03:37,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 234f2cb5 >2013-12-09 07:03:37,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 234f2cb5 >2013-12-09 07:03:37,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 437820a2 >2013-12-09 07:03:38,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 437820a2 >2013-12-09 07:03:43,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 374f2bef >2013-12-09 07:03:43,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 374f2bef >2013-12-09 07:03:43,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 514e6d07 >2013-12-09 07:03:43,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 514e6d07 >2013-12-09 07:03:48,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79e0acd2 >2013-12-09 07:03:49,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 79e0acd2 >2013-12-09 07:03:49,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: fd1dfec >2013-12-09 07:03:49,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: fd1dfec >2013-12-09 07:03:54,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64dd43d3 >2013-12-09 07:03:55,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 64dd43d3 >2013-12-09 07:03:55,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 320fa668 >2013-12-09 07:03:55,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 320fa668 >2013-12-09 07:03:56,577 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-75) No up server in cluster >2013-12-09 07:03:56,577 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-75) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:03:56,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ab94853 >2013-12-09 07:03:56,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5ab94853 >2013-12-09 07:04:00,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a59010c >2013-12-09 07:04:00,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a59010c >2013-12-09 07:04:00,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 24ec04a8 >2013-12-09 07:04:01,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24ec04a8 >2013-12-09 07:04:06,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34a355cd >2013-12-09 07:04:06,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 34a355cd >2013-12-09 07:04:06,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55ff4f78 >2013-12-09 07:04:06,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55ff4f78 >2013-12-09 07:04:11,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6fd50429 >2013-12-09 07:04:12,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6fd50429 >2013-12-09 07:04:12,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18ee3ae3 >2013-12-09 07:04:12,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18ee3ae3 >2013-12-09 07:04:17,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f54c62b >2013-12-09 07:04:18,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5f54c62b >2013-12-09 07:04:18,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 493f3efd >2013-12-09 07:04:18,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 493f3efd >2013-12-09 07:04:23,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 570cd8a8 >2013-12-09 07:04:23,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 570cd8a8 >2013-12-09 07:04:23,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11b65af8 >2013-12-09 07:04:24,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11b65af8 >2013-12-09 07:04:29,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1eedb0da >2013-12-09 07:04:29,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1eedb0da >2013-12-09 07:04:29,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44148400 >2013-12-09 07:04:30,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44148400 >2013-12-09 07:04:35,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c4da054 >2013-12-09 07:04:35,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5c4da054 >2013-12-09 07:04:35,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bf1de2 >2013-12-09 07:04:35,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1bf1de2 >2013-12-09 07:04:40,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68162167 >2013-12-09 07:04:41,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 68162167 >2013-12-09 07:04:41,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 195c8527 >2013-12-09 07:04:41,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 195c8527 >2013-12-09 07:04:46,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11aa68e8 >2013-12-09 07:04:47,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 11aa68e8 >2013-12-09 07:04:47,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17083e3e >2013-12-09 07:04:47,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17083e3e >2013-12-09 07:04:52,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d28e622 >2013-12-09 07:04:52,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2d28e622 >2013-12-09 07:04:52,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ee3a419 >2013-12-09 07:04:53,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ee3a419 >2013-12-09 07:04:56,861 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-62) No up server in cluster >2013-12-09 07:04:56,861 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-62) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:04:56,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33504be4 >2013-12-09 07:04:57,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterTasksListVDSCommand, return: [], log id: 33504be4 >2013-12-09 07:04:58,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5fbf8123 >2013-12-09 07:04:58,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5fbf8123 >2013-12-09 07:04:58,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23891e2b >2013-12-09 07:04:58,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23891e2b >2013-12-09 07:05:03,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32de0409 >2013-12-09 07:05:04,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 32de0409 >2013-12-09 07:05:04,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65755c61 >2013-12-09 07:05:04,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65755c61 >2013-12-09 07:05:09,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50b2718f >2013-12-09 07:05:10,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 50b2718f >2013-12-09 07:05:10,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67939b96 >2013-12-09 07:05:10,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67939b96 >2013-12-09 07:05:15,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5575976e >2013-12-09 07:05:15,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5575976e >2013-12-09 07:05:15,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56ee1161 >2013-12-09 07:05:16,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56ee1161 >2013-12-09 07:05:21,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 158ee1f5 >2013-12-09 07:05:21,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 158ee1f5 >2013-12-09 07:05:21,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29bd4a2c >2013-12-09 07:05:22,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29bd4a2c >2013-12-09 07:05:27,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c8976fe >2013-12-09 07:05:27,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c8976fe >2013-12-09 07:05:27,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 692fca55 >2013-12-09 07:05:27,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 692fca55 >2013-12-09 07:05:32,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41055a39 >2013-12-09 07:05:33,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 41055a39 >2013-12-09 07:05:33,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38d1fd16 >2013-12-09 07:05:33,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38d1fd16 >2013-12-09 07:05:38,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3222d9bf >2013-12-09 07:05:39,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3222d9bf >2013-12-09 07:05:39,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 161b1f39 >2013-12-09 07:05:39,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 161b1f39 >2013-12-09 07:05:44,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32db863b >2013-12-09 07:05:44,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 32db863b >2013-12-09 07:05:44,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54758d83 >2013-12-09 07:05:45,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54758d83 >2013-12-09 07:05:50,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d2df546 >2013-12-09 07:05:50,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d2df546 >2013-12-09 07:05:50,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f0e5504 >2013-12-09 07:05:50,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f0e5504 >2013-12-09 07:05:55,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 229ba5ae >2013-12-09 07:05:56,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 229ba5ae >2013-12-09 07:05:56,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37bce676 >2013-12-09 07:05:56,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37bce676 >2013-12-09 07:05:57,136 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-71) No up server in cluster >2013-12-09 07:05:57,136 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-71) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:05:57,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16eb81f7 >2013-12-09 07:05:57,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterTasksListVDSCommand, return: [], log id: 16eb81f7 >2013-12-09 07:06:01,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b94e6b7 >2013-12-09 07:06:02,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3b94e6b7 >2013-12-09 07:06:02,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55510851 >2013-12-09 07:06:02,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55510851 >2013-12-09 07:06:07,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51ae8bf3 >2013-12-09 07:06:07,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 51ae8bf3 >2013-12-09 07:06:07,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34b4d495 >2013-12-09 07:06:08,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34b4d495 >2013-12-09 07:06:13,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7669662a >2013-12-09 07:06:13,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7669662a >2013-12-09 07:06:13,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ae21aa3 >2013-12-09 07:06:13,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ae21aa3 >2013-12-09 07:06:19,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51237445 >2013-12-09 07:06:19,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 51237445 >2013-12-09 07:06:19,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41f3fd67 >2013-12-09 07:06:19,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41f3fd67 >2013-12-09 07:06:24,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6932b583 >2013-12-09 07:06:25,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6932b583 >2013-12-09 07:06:25,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70b7dce8 >2013-12-09 07:06:25,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70b7dce8 >2013-12-09 07:06:30,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2bcca890 >2013-12-09 07:06:31,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2bcca890 >2013-12-09 07:06:31,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8393fa1 >2013-12-09 07:06:31,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8393fa1 >2013-12-09 07:06:36,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ba28c47 >2013-12-09 07:06:36,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ba28c47 >2013-12-09 07:06:36,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e0c6509 >2013-12-09 07:06:37,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e0c6509 >2013-12-09 07:06:42,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79aee1f2 >2013-12-09 07:06:42,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 79aee1f2 >2013-12-09 07:06:42,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e64002 >2013-12-09 07:06:42,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e64002 >2013-12-09 07:06:47,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d52023f >2013-12-09 07:06:48,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d52023f >2013-12-09 07:06:48,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c607a2c >2013-12-09 07:06:48,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c607a2c >2013-12-09 07:06:53,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 654cb57d >2013-12-09 07:06:54,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 654cb57d >2013-12-09 07:06:54,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68aba903 >2013-12-09 07:06:54,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68aba903 >2013-12-09 07:06:57,426 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-48) No up server in cluster >2013-12-09 07:06:57,426 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-48) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:06:57,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 939073f >2013-12-09 07:06:57,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterTasksListVDSCommand, return: [], log id: 939073f >2013-12-09 07:06:59,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b89ae1f >2013-12-09 07:06:59,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b89ae1f >2013-12-09 07:06:59,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5cafa511 >2013-12-09 07:07:00,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cafa511 >2013-12-09 07:07:05,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 786da0a4 >2013-12-09 07:07:05,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 786da0a4 >2013-12-09 07:07:05,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51c1d2f >2013-12-09 07:07:05,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51c1d2f >2013-12-09 07:07:11,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f398239 >2013-12-09 07:07:11,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5f398239 >2013-12-09 07:07:11,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56711698 >2013-12-09 07:07:11,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56711698 >2013-12-09 07:07:16,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e0937a0 >2013-12-09 07:07:17,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e0937a0 >2013-12-09 07:07:17,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6914cb45 >2013-12-09 07:07:17,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6914cb45 >2013-12-09 07:07:22,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: bbcedd7 >2013-12-09 07:07:23,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: bbcedd7 >2013-12-09 07:07:23,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 553f953e >2013-12-09 07:07:23,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 553f953e >2013-12-09 07:07:28,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 654f3acb >2013-12-09 07:07:28,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 654f3acb >2013-12-09 07:07:28,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b7d54a3 >2013-12-09 07:07:29,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b7d54a3 >2013-12-09 07:07:34,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79540754 >2013-12-09 07:07:34,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 79540754 >2013-12-09 07:07:34,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6663d05d >2013-12-09 07:07:34,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6663d05d >2013-12-09 07:07:39,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a9de89d >2013-12-09 07:07:40,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a9de89d >2013-12-09 07:07:40,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68ecf32 >2013-12-09 07:07:40,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68ecf32 >2013-12-09 07:07:45,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b48c266 >2013-12-09 07:07:46,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: b48c266 >2013-12-09 07:07:46,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2de3f144 >2013-12-09 07:07:46,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2de3f144 >2013-12-09 07:07:51,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23701f93 >2013-12-09 07:07:52,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 23701f93 >2013-12-09 07:07:52,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1983716b >2013-12-09 07:07:52,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1983716b >2013-12-09 07:07:57,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42a3b253 >2013-12-09 07:07:57,720 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-67) No up server in cluster >2013-12-09 07:07:57,720 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-67) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:07:57,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51965fa8 >2013-12-09 07:07:57,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42a3b253 >2013-12-09 07:07:57,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f9bbddf >2013-12-09 07:07:57,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterTasksListVDSCommand, return: [], log id: 51965fa8 >2013-12-09 07:07:58,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f9bbddf >2013-12-09 07:08:03,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67160528 >2013-12-09 07:08:03,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 67160528 >2013-12-09 07:08:03,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1faebd81 >2013-12-09 07:08:03,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1faebd81 >2013-12-09 07:08:08,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 548e0f7e >2013-12-09 07:08:09,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 548e0f7e >2013-12-09 07:08:09,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 555c0a99 >2013-12-09 07:08:09,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 555c0a99 >2013-12-09 07:08:14,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7cc683e2 >2013-12-09 07:08:15,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7cc683e2 >2013-12-09 07:08:15,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 212da421 >2013-12-09 07:08:15,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 212da421 >2013-12-09 07:08:20,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b14a3bf >2013-12-09 07:08:20,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1b14a3bf >2013-12-09 07:08:20,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40702009 >2013-12-09 07:08:21,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40702009 >2013-12-09 07:08:26,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a3d62a0 >2013-12-09 07:08:26,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2a3d62a0 >2013-12-09 07:08:26,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ffc5be2 >2013-12-09 07:08:26,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ffc5be2 >2013-12-09 07:08:31,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3150d3b6 >2013-12-09 07:08:32,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3150d3b6 >2013-12-09 07:08:32,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14edbc9 >2013-12-09 07:08:32,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14edbc9 >2013-12-09 07:08:37,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3efe2a06 >2013-12-09 07:08:38,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3efe2a06 >2013-12-09 07:08:38,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29ba64a7 >2013-12-09 07:08:38,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29ba64a7 >2013-12-09 07:08:43,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d7f832a >2013-12-09 07:08:43,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d7f832a >2013-12-09 07:08:43,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24a759a0 >2013-12-09 07:08:44,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24a759a0 >2013-12-09 07:08:49,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58e8fd85 >2013-12-09 07:08:49,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 58e8fd85 >2013-12-09 07:08:49,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 787ee2c >2013-12-09 07:08:50,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 787ee2c >2013-12-09 07:08:55,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 756f30d4 >2013-12-09 07:08:55,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 756f30d4 >2013-12-09 07:08:55,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50c8d992 >2013-12-09 07:08:55,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50c8d992 >2013-12-09 07:08:57,994 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-21) No up server in cluster >2013-12-09 07:08:57,995 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-21) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:08:58,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 546eefed >2013-12-09 07:08:58,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterTasksListVDSCommand, return: [], log id: 546eefed >2013-12-09 07:09:00,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42d65bfb >2013-12-09 07:09:01,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42d65bfb >2013-12-09 07:09:01,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f6b10de >2013-12-09 07:09:01,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f6b10de >2013-12-09 07:09:06,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70a0d5e1 >2013-12-09 07:09:07,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 70a0d5e1 >2013-12-09 07:09:07,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6821b15f >2013-12-09 07:09:07,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6821b15f >2013-12-09 07:09:12,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f57d32b >2013-12-09 07:09:12,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f57d32b >2013-12-09 07:09:12,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9558286 >2013-12-09 07:09:13,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9558286 >2013-12-09 07:09:18,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18ce1965 >2013-12-09 07:09:18,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 18ce1965 >2013-12-09 07:09:18,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d469be2 >2013-12-09 07:09:18,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d469be2 >2013-12-09 07:09:23,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b3713ea >2013-12-09 07:09:24,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b3713ea >2013-12-09 07:09:24,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31ad8e47 >2013-12-09 07:09:24,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31ad8e47 >2013-12-09 07:09:29,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ea22355 >2013-12-09 07:09:30,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7ea22355 >2013-12-09 07:09:30,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b22f569 >2013-12-09 07:09:30,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b22f569 >2013-12-09 07:09:35,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2def77db >2013-12-09 07:09:35,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2def77db >2013-12-09 07:09:35,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f21f6a9 >2013-12-09 07:09:36,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f21f6a9 >2013-12-09 07:09:41,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 90dc90e >2013-12-09 07:09:41,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 90dc90e >2013-12-09 07:09:41,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1970f563 >2013-12-09 07:09:42,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1970f563 >2013-12-09 07:09:47,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62283316 >2013-12-09 07:09:47,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 62283316 >2013-12-09 07:09:47,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ed4072c >2013-12-09 07:09:47,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ed4072c >2013-12-09 07:09:52,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30f898c >2013-12-09 07:09:53,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 30f898c >2013-12-09 07:09:53,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e5eecfe >2013-12-09 07:09:53,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e5eecfe >2013-12-09 07:09:58,277 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-92) No up server in cluster >2013-12-09 07:09:58,277 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-92) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:09:58,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ac77c32 >2013-12-09 07:09:58,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2ac77c32 >2013-12-09 07:09:58,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ccd3b2 >2013-12-09 07:09:59,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ccd3b2 >2013-12-09 07:09:59,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ba12fd8 >2013-12-09 07:09:59,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ba12fd8 >2013-12-09 07:10:04,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16698d54 >2013-12-09 07:10:04,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 16698d54 >2013-12-09 07:10:04,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: eb7aba6 >2013-12-09 07:10:05,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: eb7aba6 >2013-12-09 07:10:10,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f461034 >2013-12-09 07:10:10,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f461034 >2013-12-09 07:10:10,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59a0e99c >2013-12-09 07:10:10,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59a0e99c >2013-12-09 07:10:15,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 255509d1 >2013-12-09 07:10:16,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 255509d1 >2013-12-09 07:10:16,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f24a19f >2013-12-09 07:10:16,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f24a19f >2013-12-09 07:10:21,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4367abda >2013-12-09 07:10:22,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4367abda >2013-12-09 07:10:22,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1186d96f >2013-12-09 07:10:22,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1186d96f >2013-12-09 07:10:27,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32006db6 >2013-12-09 07:10:28,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 32006db6 >2013-12-09 07:10:28,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d2c4ff8 >2013-12-09 07:10:28,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d2c4ff8 >2013-12-09 07:10:33,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d500fb1 >2013-12-09 07:10:33,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4d500fb1 >2013-12-09 07:10:33,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1dfafc01 >2013-12-09 07:10:34,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1dfafc01 >2013-12-09 07:10:39,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4792a67e >2013-12-09 07:10:39,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4792a67e >2013-12-09 07:10:39,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32bd1c75 >2013-12-09 07:10:39,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32bd1c75 >2013-12-09 07:10:44,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 113093af >2013-12-09 07:10:45,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 113093af >2013-12-09 07:10:45,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6934016c >2013-12-09 07:10:45,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6934016c >2013-12-09 07:10:50,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57efb74d >2013-12-09 07:10:51,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 57efb74d >2013-12-09 07:10:51,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14529591 >2013-12-09 07:10:51,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14529591 >2013-12-09 07:10:56,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ccd3bb1 >2013-12-09 07:10:56,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2ccd3bb1 >2013-12-09 07:10:56,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39bcf97f >2013-12-09 07:10:57,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39bcf97f >2013-12-09 07:10:58,570 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-76) No up server in cluster >2013-12-09 07:10:58,570 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-76) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:10:58,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 992ea5b >2013-12-09 07:10:58,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterTasksListVDSCommand, return: [], log id: 992ea5b >2013-12-09 07:11:02,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17b47101 >2013-12-09 07:11:02,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 17b47101 >2013-12-09 07:11:02,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64d62258 >2013-12-09 07:11:03,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64d62258 >2013-12-09 07:11:08,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: fc245d8 >2013-12-09 07:11:08,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: fc245d8 >2013-12-09 07:11:08,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ba13057 >2013-12-09 07:11:08,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ba13057 >2013-12-09 07:11:13,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55c2167b >2013-12-09 07:11:14,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 55c2167b >2013-12-09 07:11:14,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37af0374 >2013-12-09 07:11:14,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37af0374 >2013-12-09 07:11:19,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d837e0b >2013-12-09 07:11:20,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2d837e0b >2013-12-09 07:11:20,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 451ba67e >2013-12-09 07:11:20,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 451ba67e >2013-12-09 07:11:25,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68c4fbeb >2013-12-09 07:11:25,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 68c4fbeb >2013-12-09 07:11:25,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18a8d3cc >2013-12-09 07:11:26,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18a8d3cc >2013-12-09 07:11:31,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69aa4da0 >2013-12-09 07:11:31,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 69aa4da0 >2013-12-09 07:11:31,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d8590d5 >2013-12-09 07:11:31,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d8590d5 >2013-12-09 07:11:36,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13b516bb >2013-12-09 07:11:37,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 13b516bb >2013-12-09 07:11:37,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42f0df84 >2013-12-09 07:11:37,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42f0df84 >2013-12-09 07:11:42,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75dcb27c >2013-12-09 07:11:43,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 75dcb27c >2013-12-09 07:11:43,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4fc5d3f6 >2013-12-09 07:11:43,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fc5d3f6 >2013-12-09 07:11:48,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 606ae2da >2013-12-09 07:11:48,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 606ae2da >2013-12-09 07:11:48,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61274e4e >2013-12-09 07:11:49,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61274e4e >2013-12-09 07:11:54,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e7f65c >2013-12-09 07:11:54,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e7f65c >2013-12-09 07:11:54,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10da1c27 >2013-12-09 07:11:55,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10da1c27 >2013-12-09 07:11:58,855 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-18) No up server in cluster >2013-12-09 07:11:58,855 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-18) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:11:58,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7bcb8a21 >2013-12-09 07:11:59,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7bcb8a21 >2013-12-09 07:12:00,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ad9c2b0 >2013-12-09 07:12:00,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ad9c2b0 >2013-12-09 07:12:00,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3432250a >2013-12-09 07:12:00,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3432250a >2013-12-09 07:12:05,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4fba10a2 >2013-12-09 07:12:06,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4fba10a2 >2013-12-09 07:12:06,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10068b1c >2013-12-09 07:12:06,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10068b1c >2013-12-09 07:12:11,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c71218c >2013-12-09 07:12:12,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4c71218c >2013-12-09 07:12:12,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1bb067d1 >2013-12-09 07:12:12,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1bb067d1 >2013-12-09 07:12:17,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c0ee0c2 >2013-12-09 07:12:17,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c0ee0c2 >2013-12-09 07:12:17,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d5beced >2013-12-09 07:12:18,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d5beced >2013-12-09 07:12:23,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71f8d971 >2013-12-09 07:12:23,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 71f8d971 >2013-12-09 07:12:23,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 692a8fcf >2013-12-09 07:12:23,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 692a8fcf >2013-12-09 07:12:28,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 517c187a >2013-12-09 07:12:29,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 517c187a >2013-12-09 07:12:29,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23070d30 >2013-12-09 07:12:29,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23070d30 >2013-12-09 07:12:34,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36767a50 >2013-12-09 07:12:35,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 36767a50 >2013-12-09 07:12:35,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79b3f967 >2013-12-09 07:12:35,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79b3f967 >2013-12-09 07:12:40,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 514c299b >2013-12-09 07:12:41,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 514c299b >2013-12-09 07:12:41,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24d7ea9e >2013-12-09 07:12:41,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24d7ea9e >2013-12-09 07:12:46,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4923a8a1 >2013-12-09 07:12:46,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4923a8a1 >2013-12-09 07:12:46,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30dd1b58 >2013-12-09 07:12:47,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30dd1b58 >2013-12-09 07:12:52,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d438044 >2013-12-09 07:12:52,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d438044 >2013-12-09 07:12:52,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77f3e865 >2013-12-09 07:12:52,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77f3e865 >2013-12-09 07:12:57,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 746c50da >2013-12-09 07:12:58,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 746c50da >2013-12-09 07:12:58,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 201d844f >2013-12-09 07:12:58,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 201d844f >2013-12-09 07:12:59,149 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-39) [63f3d095] No up server in cluster >2013-12-09 07:12:59,149 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-39) [63f3d095] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:12:59,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70e29b4e >2013-12-09 07:12:59,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterTasksListVDSCommand, return: [], log id: 70e29b4e >2013-12-09 07:13:03,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19137c4b >2013-12-09 07:13:04,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 19137c4b >2013-12-09 07:13:04,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d49cdeb >2013-12-09 07:13:04,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d49cdeb >2013-12-09 07:13:09,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54736362 >2013-12-09 07:13:09,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 54736362 >2013-12-09 07:13:09,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b3ab247 >2013-12-09 07:13:10,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b3ab247 >2013-12-09 07:13:15,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6afcf5e6 >2013-12-09 07:13:15,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6afcf5e6 >2013-12-09 07:13:15,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7745d27d >2013-12-09 07:13:15,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7745d27d >2013-12-09 07:13:20,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65395a64 >2013-12-09 07:13:21,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 65395a64 >2013-12-09 07:13:21,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76298fe1 >2013-12-09 07:13:21,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76298fe1 >2013-12-09 07:13:26,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9dfbd03 >2013-12-09 07:13:27,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 9dfbd03 >2013-12-09 07:13:27,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b668e9e >2013-12-09 07:13:27,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b668e9e >2013-12-09 07:13:32,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: fb64e14 >2013-12-09 07:13:33,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: fb64e14 >2013-12-09 07:13:33,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 728d6ab5 >2013-12-09 07:13:33,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 728d6ab5 >2013-12-09 07:13:38,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7119c04a >2013-12-09 07:13:38,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7119c04a >2013-12-09 07:13:38,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6adedbd2 >2013-12-09 07:13:39,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6adedbd2 >2013-12-09 07:13:44,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48731094 >2013-12-09 07:13:44,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 48731094 >2013-12-09 07:13:44,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: dcac171 >2013-12-09 07:13:44,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: dcac171 >2013-12-09 07:13:49,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 344bec81 >2013-12-09 07:13:50,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 344bec81 >2013-12-09 07:13:50,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70784f24 >2013-12-09 07:13:50,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70784f24 >2013-12-09 07:13:55,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14022534 >2013-12-09 07:13:56,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 14022534 >2013-12-09 07:13:56,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f06162 >2013-12-09 07:13:56,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f06162 >2013-12-09 07:13:59,433 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-19) No up server in cluster >2013-12-09 07:13:59,433 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-19) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:13:59,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 252b2e9f >2013-12-09 07:13:59,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterTasksListVDSCommand, return: [], log id: 252b2e9f >2013-12-09 07:14:01,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a4126f6 >2013-12-09 07:14:01,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1a4126f6 >2013-12-09 07:14:01,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3122f8ec >2013-12-09 07:14:02,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3122f8ec >2013-12-09 07:14:07,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33562482 >2013-12-09 07:14:07,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 33562482 >2013-12-09 07:14:07,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 638fc55a >2013-12-09 07:14:07,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 638fc55a >2013-12-09 07:14:12,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79a418f6 >2013-12-09 07:14:13,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 79a418f6 >2013-12-09 07:14:13,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7009c789 >2013-12-09 07:14:13,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7009c789 >2013-12-09 07:14:18,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 15bf9631 >2013-12-09 07:14:19,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 15bf9631 >2013-12-09 07:14:19,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1bb0ec92 >2013-12-09 07:14:19,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1bb0ec92 >2013-12-09 07:14:24,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e1d4631 >2013-12-09 07:14:24,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6e1d4631 >2013-12-09 07:14:24,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b96bdf6 >2013-12-09 07:14:25,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b96bdf6 >2013-12-09 07:14:30,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6fc7e486 >2013-12-09 07:14:30,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6fc7e486 >2013-12-09 07:14:30,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: cf335f6 >2013-12-09 07:14:31,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: cf335f6 >2013-12-09 07:14:36,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b4ad9b >2013-12-09 07:14:36,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6b4ad9b >2013-12-09 07:14:36,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23e556c7 >2013-12-09 07:14:36,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23e556c7 >2013-12-09 07:14:41,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7feb99fa >2013-12-09 07:14:42,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7feb99fa >2013-12-09 07:14:42,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79fe2b82 >2013-12-09 07:14:42,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79fe2b82 >2013-12-09 07:14:47,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ad77ce2 >2013-12-09 07:14:48,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ad77ce2 >2013-12-09 07:14:48,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: fbc8526 >2013-12-09 07:14:48,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: fbc8526 >2013-12-09 07:14:53,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6169bea9 >2013-12-09 07:14:53,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6169bea9 >2013-12-09 07:14:53,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21a1ed9 >2013-12-09 07:14:54,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21a1ed9 >2013-12-09 07:14:59,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2232c67c >2013-12-09 07:14:59,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2232c67c >2013-12-09 07:14:59,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73e38041 >2013-12-09 07:14:59,703 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) No up server in cluster >2013-12-09 07:14:59,703 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:14:59,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 128d6577 >2013-12-09 07:14:59,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73e38041 >2013-12-09 07:14:59,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterTasksListVDSCommand, return: [], log id: 128d6577 >2013-12-09 07:15:04,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e53ef17 >2013-12-09 07:15:05,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: e53ef17 >2013-12-09 07:15:05,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70d8c62e >2013-12-09 07:15:05,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70d8c62e >2013-12-09 07:15:10,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a667e3 >2013-12-09 07:15:11,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a667e3 >2013-12-09 07:15:11,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6460bd41 >2013-12-09 07:15:11,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6460bd41 >2013-12-09 07:15:16,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15651917 >2013-12-09 07:15:16,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 15651917 >2013-12-09 07:15:16,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b884f7e >2013-12-09 07:15:17,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b884f7e >2013-12-09 07:15:22,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f1807a2 >2013-12-09 07:15:22,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f1807a2 >2013-12-09 07:15:22,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 93102a8 >2013-12-09 07:15:23,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 93102a8 >2013-12-09 07:15:28,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51b530f7 >2013-12-09 07:15:28,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 51b530f7 >2013-12-09 07:15:28,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63debcb6 >2013-12-09 07:15:28,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63debcb6 >2013-12-09 07:15:33,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57addc8b >2013-12-09 07:15:34,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 57addc8b >2013-12-09 07:15:34,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ebd7e8d >2013-12-09 07:15:34,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ebd7e8d >2013-12-09 07:15:39,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c05c6fc >2013-12-09 07:15:40,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c05c6fc >2013-12-09 07:15:40,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 715e499f >2013-12-09 07:15:40,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 715e499f >2013-12-09 07:15:45,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 106020cd >2013-12-09 07:15:45,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 106020cd >2013-12-09 07:15:45,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b0f6bde >2013-12-09 07:15:46,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b0f6bde >2013-12-09 07:15:51,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1373caf7 >2013-12-09 07:15:51,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1373caf7 >2013-12-09 07:15:51,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 597d661b >2013-12-09 07:15:51,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 597d661b >2013-12-09 07:15:56,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 139851d8 >2013-12-09 07:15:57,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 139851d8 >2013-12-09 07:15:57,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ec8b5e0 >2013-12-09 07:15:57,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ec8b5e0 >2013-12-09 07:15:59,967 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-91) No up server in cluster >2013-12-09 07:15:59,967 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-91) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:15:59,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56d69a0b >2013-12-09 07:16:00,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterTasksListVDSCommand, return: [], log id: 56d69a0b >2013-12-09 07:16:02,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33578745 >2013-12-09 07:16:03,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 33578745 >2013-12-09 07:16:03,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 235a1a0 >2013-12-09 07:16:03,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 235a1a0 >2013-12-09 07:16:08,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48b60085 >2013-12-09 07:16:08,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 48b60085 >2013-12-09 07:16:08,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ae11c68 >2013-12-09 07:16:09,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ae11c68 >2013-12-09 07:16:14,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f206301 >2013-12-09 07:16:14,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5f206301 >2013-12-09 07:16:14,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: adb4f57 >2013-12-09 07:16:15,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: adb4f57 >2013-12-09 07:16:20,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d20b3e1 >2013-12-09 07:16:20,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d20b3e1 >2013-12-09 07:16:20,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 253f41e7 >2013-12-09 07:16:20,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 253f41e7 >2013-12-09 07:16:25,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5832b86f >2013-12-09 07:16:26,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5832b86f >2013-12-09 07:16:26,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64af60cd >2013-12-09 07:16:26,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64af60cd >2013-12-09 07:16:31,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2349332c >2013-12-09 07:16:32,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2349332c >2013-12-09 07:16:32,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1efc58c8 >2013-12-09 07:16:32,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1efc58c8 >2013-12-09 07:16:37,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 643d8559 >2013-12-09 07:16:37,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 643d8559 >2013-12-09 07:16:37,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 464c23ef >2013-12-09 07:16:38,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 464c23ef >2013-12-09 07:16:43,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19315600 >2013-12-09 07:16:43,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19315600 >2013-12-09 07:16:43,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8bb0403 >2013-12-09 07:16:43,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8bb0403 >2013-12-09 07:16:48,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 274c985c >2013-12-09 07:16:49,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 274c985c >2013-12-09 07:16:49,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 816d4c7 >2013-12-09 07:16:49,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 816d4c7 >2013-12-09 07:16:54,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7fd535af >2013-12-09 07:16:55,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7fd535af >2013-12-09 07:16:55,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a69be77 >2013-12-09 07:16:55,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a69be77 >2013-12-09 07:17:00,247 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-44) No up server in cluster >2013-12-09 07:17:00,247 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-44) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:17:00,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3029fa62 >2013-12-09 07:17:00,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: cf978b8 >2013-12-09 07:17:00,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3029fa62 >2013-12-09 07:17:00,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: cf978b8 >2013-12-09 07:17:00,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 388afbbb >2013-12-09 07:17:01,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 388afbbb >2013-12-09 07:17:06,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 454c6da7 >2013-12-09 07:17:06,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 454c6da7 >2013-12-09 07:17:06,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4420fe81 >2013-12-09 07:17:07,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4420fe81 >2013-12-09 07:17:12,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7772c82 >2013-12-09 07:17:12,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7772c82 >2013-12-09 07:17:12,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4752d12c >2013-12-09 07:17:12,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4752d12c >2013-12-09 07:17:17,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12684dfb >2013-12-09 07:17:18,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 12684dfb >2013-12-09 07:17:18,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d97ef40 >2013-12-09 07:17:18,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d97ef40 >2013-12-09 07:17:23,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77d48ce >2013-12-09 07:17:24,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 77d48ce >2013-12-09 07:17:24,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 22ca306b >2013-12-09 07:17:24,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22ca306b >2013-12-09 07:17:29,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c8e1a8 >2013-12-09 07:17:29,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3c8e1a8 >2013-12-09 07:17:29,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 302370e3 >2013-12-09 07:17:30,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 302370e3 >2013-12-09 07:17:35,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5cd8cbe7 >2013-12-09 07:17:35,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5cd8cbe7 >2013-12-09 07:17:35,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 282976f0 >2013-12-09 07:17:35,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 282976f0 >2013-12-09 07:17:40,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35648ce5 >2013-12-09 07:17:41,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 35648ce5 >2013-12-09 07:17:41,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72743eb4 >2013-12-09 07:17:41,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72743eb4 >2013-12-09 07:17:46,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2cfbbbe >2013-12-09 07:17:47,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2cfbbbe >2013-12-09 07:17:47,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31c32af1 >2013-12-09 07:17:47,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31c32af1 >2013-12-09 07:17:52,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7810e5aa >2013-12-09 07:17:53,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7810e5aa >2013-12-09 07:17:53,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77cd4b55 >2013-12-09 07:17:53,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77cd4b55 >2013-12-09 07:17:58,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: efb9879 >2013-12-09 07:17:58,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: efb9879 >2013-12-09 07:17:58,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a93db01 >2013-12-09 07:17:59,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a93db01 >2013-12-09 07:18:00,533 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-16) No up server in cluster >2013-12-09 07:18:00,533 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-16) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:18:00,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74e060ec >2013-12-09 07:18:00,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterTasksListVDSCommand, return: [], log id: 74e060ec >2013-12-09 07:18:04,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42254bbb >2013-12-09 07:18:04,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42254bbb >2013-12-09 07:18:04,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 290621a9 >2013-12-09 07:18:04,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 290621a9 >2013-12-09 07:18:09,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a7b5bd8 >2013-12-09 07:18:10,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a7b5bd8 >2013-12-09 07:18:10,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62063b5 >2013-12-09 07:18:10,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62063b5 >2013-12-09 07:18:15,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1dd95363 >2013-12-09 07:18:16,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1dd95363 >2013-12-09 07:18:16,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52a146af >2013-12-09 07:18:16,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52a146af >2013-12-09 07:18:21,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5564e99 >2013-12-09 07:18:21,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5564e99 >2013-12-09 07:18:21,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68be183d >2013-12-09 07:18:22,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68be183d >2013-12-09 07:18:27,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f545f56 >2013-12-09 07:18:27,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3f545f56 >2013-12-09 07:18:27,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26279bbb >2013-12-09 07:18:27,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26279bbb >2013-12-09 07:18:32,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d8331a5 >2013-12-09 07:18:33,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d8331a5 >2013-12-09 07:18:33,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9864bde >2013-12-09 07:18:33,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9864bde >2013-12-09 07:18:38,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3cb2296a >2013-12-09 07:18:39,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3cb2296a >2013-12-09 07:18:39,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10df85b2 >2013-12-09 07:18:39,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10df85b2 >2013-12-09 07:18:44,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7523f8c8 >2013-12-09 07:18:45,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7523f8c8 >2013-12-09 07:18:45,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b0d1617 >2013-12-09 07:18:45,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b0d1617 >2013-12-09 07:18:50,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a26c76b >2013-12-09 07:18:50,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1a26c76b >2013-12-09 07:18:50,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5cd4b59f >2013-12-09 07:18:51,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cd4b59f >2013-12-09 07:18:56,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11d8ad21 >2013-12-09 07:18:56,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 11d8ad21 >2013-12-09 07:18:56,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c7c696f >2013-12-09 07:18:56,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c7c696f >2013-12-09 07:19:00,821 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-94) No up server in cluster >2013-12-09 07:19:00,821 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-94) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:19:00,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1fdd25e >2013-12-09 07:19:01,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1fdd25e >2013-12-09 07:19:01,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b9a3eef >2013-12-09 07:19:02,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b9a3eef >2013-12-09 07:19:02,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5726f090 >2013-12-09 07:19:02,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5726f090 >2013-12-09 07:19:07,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 317e78cf >2013-12-09 07:19:08,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 317e78cf >2013-12-09 07:19:08,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28cc9248 >2013-12-09 07:19:08,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28cc9248 >2013-12-09 07:19:13,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 207a3d5b >2013-12-09 07:19:13,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 207a3d5b >2013-12-09 07:19:13,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 349fa757 >2013-12-09 07:19:14,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 349fa757 >2013-12-09 07:19:19,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6fa45cb9 >2013-12-09 07:19:19,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6fa45cb9 >2013-12-09 07:19:19,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a28b216 >2013-12-09 07:19:19,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a28b216 >2013-12-09 07:19:24,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7459c376 >2013-12-09 07:19:25,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7459c376 >2013-12-09 07:19:25,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64662d21 >2013-12-09 07:19:25,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64662d21 >2013-12-09 07:19:30,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 668393e8 >2013-12-09 07:19:31,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 668393e8 >2013-12-09 07:19:31,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c54cc51 >2013-12-09 07:19:31,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c54cc51 >2013-12-09 07:19:36,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f1f078d >2013-12-09 07:19:37,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f1f078d >2013-12-09 07:19:37,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73bbb4d8 >2013-12-09 07:19:37,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73bbb4d8 >2013-12-09 07:19:42,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 428b67a2 >2013-12-09 07:19:42,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 428b67a2 >2013-12-09 07:19:42,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 218792ec >2013-12-09 07:19:43,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 218792ec >2013-12-09 07:19:48,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44d95e4b >2013-12-09 07:19:48,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 44d95e4b >2013-12-09 07:19:48,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2040d70a >2013-12-09 07:19:48,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2040d70a >2013-12-09 07:19:53,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d3ff960 >2013-12-09 07:19:54,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d3ff960 >2013-12-09 07:19:54,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65d7f847 >2013-12-09 07:19:54,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65d7f847 >2013-12-09 07:19:59,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b4750d7 >2013-12-09 07:20:00,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b4750d7 >2013-12-09 07:20:00,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43735846 >2013-12-09 07:20:00,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43735846 >2013-12-09 07:20:01,098 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-28) No up server in cluster >2013-12-09 07:20:01,098 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-28) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:20:01,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75c84d8b >2013-12-09 07:20:01,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterTasksListVDSCommand, return: [], log id: 75c84d8b >2013-12-09 07:20:05,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4aeef4a8 >2013-12-09 07:20:05,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4aeef4a8 >2013-12-09 07:20:05,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f5c62aa >2013-12-09 07:20:06,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f5c62aa >2013-12-09 07:20:11,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25d166fb >2013-12-09 07:20:11,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 25d166fb >2013-12-09 07:20:11,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e5de02b >2013-12-09 07:20:12,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e5de02b >2013-12-09 07:20:17,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3abbdc0c >2013-12-09 07:20:17,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3abbdc0c >2013-12-09 07:20:17,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1153e74 >2013-12-09 07:20:17,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1153e74 >2013-12-09 07:20:22,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 175fcb52 >2013-12-09 07:20:23,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 175fcb52 >2013-12-09 07:20:23,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2837655d >2013-12-09 07:20:23,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2837655d >2013-12-09 07:20:28,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33b17652 >2013-12-09 07:20:29,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 33b17652 >2013-12-09 07:20:29,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d1317c6 >2013-12-09 07:20:29,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d1317c6 >2013-12-09 07:20:34,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7db1cd70 >2013-12-09 07:20:34,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7db1cd70 >2013-12-09 07:20:34,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78b87234 >2013-12-09 07:20:35,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78b87234 >2013-12-09 07:20:40,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72462788 >2013-12-09 07:20:40,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 72462788 >2013-12-09 07:20:40,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78825ea4 >2013-12-09 07:20:40,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78825ea4 >2013-12-09 07:20:45,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31166b36 >2013-12-09 07:20:46,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 31166b36 >2013-12-09 07:20:46,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13e4d54a >2013-12-09 07:20:46,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13e4d54a >2013-12-09 07:20:51,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5507092c >2013-12-09 07:20:52,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5507092c >2013-12-09 07:20:52,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52ebf0a2 >2013-12-09 07:20:52,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52ebf0a2 >2013-12-09 07:20:57,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3123c8c9 >2013-12-09 07:20:58,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3123c8c9 >2013-12-09 07:20:58,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1498c4a0 >2013-12-09 07:20:58,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1498c4a0 >2013-12-09 07:21:01,377 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-75) No up server in cluster >2013-12-09 07:21:01,377 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-75) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:21:01,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e50b41 >2013-12-09 07:21:01,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1e50b41 >2013-12-09 07:21:03,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62f0386a >2013-12-09 07:21:03,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 62f0386a >2013-12-09 07:21:03,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4984bb70 >2013-12-09 07:21:04,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4984bb70 >2013-12-09 07:21:09,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ec940ff >2013-12-09 07:21:09,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3ec940ff >2013-12-09 07:21:09,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e981717 >2013-12-09 07:21:09,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e981717 >2013-12-09 07:21:14,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78ce71fe >2013-12-09 07:21:15,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 78ce71fe >2013-12-09 07:21:15,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 272187d9 >2013-12-09 07:21:15,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 272187d9 >2013-12-09 07:21:20,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 698f1d45 >2013-12-09 07:21:21,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 698f1d45 >2013-12-09 07:21:21,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7df517d2 >2013-12-09 07:21:21,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7df517d2 >2013-12-09 07:21:26,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d5e92e8 >2013-12-09 07:21:26,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d5e92e8 >2013-12-09 07:21:26,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 168da485 >2013-12-09 07:21:27,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 168da485 >2013-12-09 07:21:32,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a430e99 >2013-12-09 07:21:32,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3a430e99 >2013-12-09 07:21:32,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41dec777 >2013-12-09 07:21:32,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41dec777 >2013-12-09 07:21:37,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54394bae >2013-12-09 07:21:38,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 54394bae >2013-12-09 07:21:38,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 669babef >2013-12-09 07:21:38,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 669babef >2013-12-09 07:21:43,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 116fb056 >2013-12-09 07:21:44,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 116fb056 >2013-12-09 07:21:44,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ebd8f7d >2013-12-09 07:21:44,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ebd8f7d >2013-12-09 07:21:49,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e4ae84e >2013-12-09 07:21:49,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e4ae84e >2013-12-09 07:21:49,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78718c6c >2013-12-09 07:21:50,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78718c6c >2013-12-09 07:21:55,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 25d445f6 >2013-12-09 07:21:55,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 25d445f6 >2013-12-09 07:21:55,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e4b548 >2013-12-09 07:21:55,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e4b548 >2013-12-09 07:22:01,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32687538 >2013-12-09 07:22:01,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 32687538 >2013-12-09 07:22:01,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a3dd65a >2013-12-09 07:22:01,660 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-30) No up server in cluster >2013-12-09 07:22:01,660 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-30) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:22:01,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 522c3987 >2013-12-09 07:22:01,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a3dd65a >2013-12-09 07:22:01,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterTasksListVDSCommand, return: [], log id: 522c3987 >2013-12-09 07:22:06,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18b31048 >2013-12-09 07:22:07,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 18b31048 >2013-12-09 07:22:07,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3753250c >2013-12-09 07:22:07,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3753250c >2013-12-09 07:22:12,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: cbec414 >2013-12-09 07:22:13,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: cbec414 >2013-12-09 07:22:13,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 452af927 >2013-12-09 07:22:13,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 452af927 >2013-12-09 07:22:18,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17c14424 >2013-12-09 07:22:18,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 17c14424 >2013-12-09 07:22:18,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23762c99 >2013-12-09 07:22:19,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23762c99 >2013-12-09 07:22:24,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63468475 >2013-12-09 07:22:24,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 63468475 >2013-12-09 07:22:24,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53eeffa6 >2013-12-09 07:22:24,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53eeffa6 >2013-12-09 07:22:29,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15df41d2 >2013-12-09 07:22:30,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 15df41d2 >2013-12-09 07:22:30,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e7975b5 >2013-12-09 07:22:30,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e7975b5 >2013-12-09 07:22:35,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ad6b739 >2013-12-09 07:22:36,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7ad6b739 >2013-12-09 07:22:36,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1fc705b8 >2013-12-09 07:22:36,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1fc705b8 >2013-12-09 07:22:41,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b38f31 >2013-12-09 07:22:41,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6b38f31 >2013-12-09 07:22:42,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ea252cf >2013-12-09 07:22:42,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ea252cf >2013-12-09 07:22:47,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34eb6c0a >2013-12-09 07:22:47,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 34eb6c0a >2013-12-09 07:22:47,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 265e54dd >2013-12-09 07:22:48,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 265e54dd >2013-12-09 07:22:53,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42c232aa >2013-12-09 07:22:53,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42c232aa >2013-12-09 07:22:53,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5681fb4b >2013-12-09 07:22:53,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5681fb4b >2013-12-09 07:22:58,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31c05fa >2013-12-09 07:22:59,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 31c05fa >2013-12-09 07:22:59,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c95bdc2 >2013-12-09 07:22:59,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c95bdc2 >2013-12-09 07:23:01,929 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-57) No up server in cluster >2013-12-09 07:23:01,929 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-57) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:23:01,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b655246 >2013-12-09 07:23:02,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterTasksListVDSCommand, return: [], log id: b655246 >2013-12-09 07:23:04,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60ab2c9c >2013-12-09 07:23:05,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 60ab2c9c >2013-12-09 07:23:05,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65787a14 >2013-12-09 07:23:05,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65787a14 >2013-12-09 07:23:10,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 186d8200 >2013-12-09 07:23:10,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 186d8200 >2013-12-09 07:23:10,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d538ac2 >2013-12-09 07:23:11,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d538ac2 >2013-12-09 07:23:16,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78a67f85 >2013-12-09 07:23:16,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 78a67f85 >2013-12-09 07:23:16,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7997b2ca >2013-12-09 07:23:16,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7997b2ca >2013-12-09 07:23:21,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38125ed0 >2013-12-09 07:23:22,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 38125ed0 >2013-12-09 07:23:22,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48aab221 >2013-12-09 07:23:22,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48aab221 >2013-12-09 07:23:27,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32b48fab >2013-12-09 07:23:28,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 32b48fab >2013-12-09 07:23:28,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 89ab7d5 >2013-12-09 07:23:28,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 89ab7d5 >2013-12-09 07:23:33,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f9d9e65 >2013-12-09 07:23:34,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f9d9e65 >2013-12-09 07:23:34,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 225496e9 >2013-12-09 07:23:34,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 225496e9 >2013-12-09 07:23:39,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1dbd634c >2013-12-09 07:23:39,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1dbd634c >2013-12-09 07:23:39,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74003bd3 >2013-12-09 07:23:40,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74003bd3 >2013-12-09 07:23:45,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2bd6cbcc >2013-12-09 07:23:45,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2bd6cbcc >2013-12-09 07:23:45,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16745a82 >2013-12-09 07:23:45,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16745a82 >2013-12-09 07:23:50,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a9167c5 >2013-12-09 07:23:51,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3a9167c5 >2013-12-09 07:23:51,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 274d84ff >2013-12-09 07:23:51,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 274d84ff >2013-12-09 07:23:56,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e0f11fa >2013-12-09 07:23:57,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2e0f11fa >2013-12-09 07:23:57,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7199613a >2013-12-09 07:23:57,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7199613a >2013-12-09 07:24:02,218 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-48) No up server in cluster >2013-12-09 07:24:02,219 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-48) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:24:02,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 300c0b45 >2013-12-09 07:24:02,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5147477d >2013-12-09 07:24:02,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterTasksListVDSCommand, return: [], log id: 300c0b45 >2013-12-09 07:24:02,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5147477d >2013-12-09 07:24:02,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73f50320 >2013-12-09 07:24:03,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73f50320 >2013-12-09 07:24:08,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2af86c24 >2013-12-09 07:24:08,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2af86c24 >2013-12-09 07:24:08,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79a31b19 >2013-12-09 07:24:08,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79a31b19 >2013-12-09 07:24:13,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a5f3fd2 >2013-12-09 07:24:14,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a5f3fd2 >2013-12-09 07:24:14,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f9a551c >2013-12-09 07:24:14,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f9a551c >2013-12-09 07:24:19,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d547d5b >2013-12-09 07:24:20,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d547d5b >2013-12-09 07:24:20,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 617e5878 >2013-12-09 07:24:20,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 617e5878 >2013-12-09 07:24:25,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3bd3969 >2013-12-09 07:24:26,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3bd3969 >2013-12-09 07:24:26,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e929e86 >2013-12-09 07:24:26,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e929e86 >2013-12-09 07:24:31,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26ab7061 >2013-12-09 07:24:31,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 26ab7061 >2013-12-09 07:24:31,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7123290c >2013-12-09 07:24:32,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7123290c >2013-12-09 07:24:37,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6775df66 >2013-12-09 07:24:37,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6775df66 >2013-12-09 07:24:37,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ddeb26a >2013-12-09 07:24:37,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ddeb26a >2013-12-09 07:24:42,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c45479b >2013-12-09 07:24:43,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c45479b >2013-12-09 07:24:43,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77741a98 >2013-12-09 07:24:43,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77741a98 >2013-12-09 07:24:48,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f35f53b >2013-12-09 07:24:49,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f35f53b >2013-12-09 07:24:49,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7be55887 >2013-12-09 07:24:49,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7be55887 >2013-12-09 07:24:54,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ca83933 >2013-12-09 07:24:54,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: ca83933 >2013-12-09 07:24:54,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54fe9d7a >2013-12-09 07:24:55,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54fe9d7a >2013-12-09 07:25:00,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ad0a18c >2013-12-09 07:25:00,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6ad0a18c >2013-12-09 07:25:00,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16ce976 >2013-12-09 07:25:00,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16ce976 >2013-12-09 07:25:02,486 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-67) No up server in cluster >2013-12-09 07:25:02,486 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-67) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:25:02,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4aa9bdf0 >2013-12-09 07:25:02,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4aa9bdf0 >2013-12-09 07:25:05,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77ed4dd6 >2013-12-09 07:25:06,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 77ed4dd6 >2013-12-09 07:25:06,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ec80bcf >2013-12-09 07:25:06,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ec80bcf >2013-12-09 07:25:11,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 255301ca >2013-12-09 07:25:12,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 255301ca >2013-12-09 07:25:12,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28eb0fab >2013-12-09 07:25:12,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28eb0fab >2013-12-09 07:25:17,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ddd26b >2013-12-09 07:25:18,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ddd26b >2013-12-09 07:25:18,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 445d4c0b >2013-12-09 07:25:18,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 445d4c0b >2013-12-09 07:25:23,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52a30fe3 >2013-12-09 07:25:23,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 52a30fe3 >2013-12-09 07:25:23,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66f4cfbf >2013-12-09 07:25:24,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66f4cfbf >2013-12-09 07:25:29,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11130b50 >2013-12-09 07:25:29,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 11130b50 >2013-12-09 07:25:29,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e1d3c8d >2013-12-09 07:25:29,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e1d3c8d >2013-12-09 07:25:34,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ed16c3 >2013-12-09 07:25:35,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ed16c3 >2013-12-09 07:25:35,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61ef85e2 >2013-12-09 07:25:35,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61ef85e2 >2013-12-09 07:25:40,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 484c86bb >2013-12-09 07:25:41,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 484c86bb >2013-12-09 07:25:41,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 294e95b3 >2013-12-09 07:25:41,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 294e95b3 >2013-12-09 07:25:46,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50d51682 >2013-12-09 07:25:46,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 50d51682 >2013-12-09 07:25:46,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7482b044 >2013-12-09 07:25:47,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7482b044 >2013-12-09 07:25:52,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2814e2ab >2013-12-09 07:25:52,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2814e2ab >2013-12-09 07:25:52,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39d5a045 >2013-12-09 07:25:52,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39d5a045 >2013-12-09 07:25:57,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e178c4a >2013-12-09 07:25:58,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3e178c4a >2013-12-09 07:25:58,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ab7cef1 >2013-12-09 07:25:58,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ab7cef1 >2013-12-09 07:26:02,777 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-25) No up server in cluster >2013-12-09 07:26:02,777 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-25) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:26:02,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71d26c43 >2013-12-09 07:26:03,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterTasksListVDSCommand, return: [], log id: 71d26c43 >2013-12-09 07:26:03,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 170beab9 >2013-12-09 07:26:04,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 170beab9 >2013-12-09 07:26:04,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 114f19e8 >2013-12-09 07:26:04,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 114f19e8 >2013-12-09 07:26:09,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36d9b309 >2013-12-09 07:26:10,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 36d9b309 >2013-12-09 07:26:10,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c54f702 >2013-12-09 07:26:10,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c54f702 >2013-12-09 07:26:15,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79e3c5ff >2013-12-09 07:26:15,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 79e3c5ff >2013-12-09 07:26:15,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ae47bb5 >2013-12-09 07:26:16,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ae47bb5 >2013-12-09 07:26:21,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71eb03ab >2013-12-09 07:26:21,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 71eb03ab >2013-12-09 07:26:21,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30c53cc9 >2013-12-09 07:26:21,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30c53cc9 >2013-12-09 07:26:26,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ae1b5fa >2013-12-09 07:26:27,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3ae1b5fa >2013-12-09 07:26:27,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3decee8c >2013-12-09 07:26:27,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3decee8c >2013-12-09 07:26:32,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5491c5fb >2013-12-09 07:26:33,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5491c5fb >2013-12-09 07:26:33,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c85c2c >2013-12-09 07:26:33,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c85c2c >2013-12-09 07:26:38,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a9eead4 >2013-12-09 07:26:39,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1a9eead4 >2013-12-09 07:26:39,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60b764d2 >2013-12-09 07:26:39,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60b764d2 >2013-12-09 07:26:44,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 322e0394 >2013-12-09 07:26:44,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 322e0394 >2013-12-09 07:26:44,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71c97346 >2013-12-09 07:26:45,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71c97346 >2013-12-09 07:26:50,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 286c9c9f >2013-12-09 07:26:50,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 286c9c9f >2013-12-09 07:26:50,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c1df180 >2013-12-09 07:26:50,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c1df180 >2013-12-09 07:26:55,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13189f8f >2013-12-09 07:26:56,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 13189f8f >2013-12-09 07:26:56,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 635b968a >2013-12-09 07:26:56,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 635b968a >2013-12-09 07:27:01,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b69b565 >2013-12-09 07:27:02,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3b69b565 >2013-12-09 07:27:02,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55a00add >2013-12-09 07:27:02,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55a00add >2013-12-09 07:27:03,059 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-46) No up server in cluster >2013-12-09 07:27:03,059 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-46) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:27:03,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f5e9d72 >2013-12-09 07:27:03,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5f5e9d72 >2013-12-09 07:27:07,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3abb5a0b >2013-12-09 07:27:07,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3abb5a0b >2013-12-09 07:27:07,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ab3b10a >2013-12-09 07:27:08,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ab3b10a >2013-12-09 07:27:13,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53fbd930 >2013-12-09 07:27:13,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 53fbd930 >2013-12-09 07:27:13,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7364d4db >2013-12-09 07:27:13,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7364d4db >2013-12-09 07:27:19,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56b4d435 >2013-12-09 07:27:19,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 56b4d435 >2013-12-09 07:27:19,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4db3dfd4 >2013-12-09 07:27:19,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4db3dfd4 >2013-12-09 07:27:24,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 770eb7e1 >2013-12-09 07:27:25,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 770eb7e1 >2013-12-09 07:27:25,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b47fd2e >2013-12-09 07:27:25,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b47fd2e >2013-12-09 07:27:30,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 15d19e00 >2013-12-09 07:27:31,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 15d19e00 >2013-12-09 07:27:31,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 22e95c32 >2013-12-09 07:27:31,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22e95c32 >2013-12-09 07:27:36,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20ddb75f >2013-12-09 07:27:36,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 20ddb75f >2013-12-09 07:27:36,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ef777a9 >2013-12-09 07:27:37,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ef777a9 >2013-12-09 07:27:42,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f410abb >2013-12-09 07:27:42,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f410abb >2013-12-09 07:27:42,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 719b2c38 >2013-12-09 07:27:42,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 719b2c38 >2013-12-09 07:27:47,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78b4225c >2013-12-09 07:27:48,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 78b4225c >2013-12-09 07:27:48,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78ddbcc3 >2013-12-09 07:27:48,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78ddbcc3 >2013-12-09 07:27:53,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46319d5f >2013-12-09 07:27:54,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 46319d5f >2013-12-09 07:27:54,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 152ee5be >2013-12-09 07:27:54,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 152ee5be >2013-12-09 07:27:59,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 90c0458 >2013-12-09 07:28:00,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 90c0458 >2013-12-09 07:28:00,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21837235 >2013-12-09 07:28:00,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21837235 >2013-12-09 07:28:03,323 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-45) No up server in cluster >2013-12-09 07:28:03,323 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-45) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:28:03,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6021a1a1 >2013-12-09 07:28:03,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6021a1a1 >2013-12-09 07:28:05,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b4effd9 >2013-12-09 07:28:05,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b4effd9 >2013-12-09 07:28:05,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4cf9c514 >2013-12-09 07:28:06,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4cf9c514 >2013-12-09 07:28:11,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 49fb5792 >2013-12-09 07:28:11,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 49fb5792 >2013-12-09 07:28:11,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6aa616d8 >2013-12-09 07:28:11,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6aa616d8 >2013-12-09 07:28:16,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f68fc9f >2013-12-09 07:28:17,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f68fc9f >2013-12-09 07:28:17,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f9bd3de >2013-12-09 07:28:17,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f9bd3de >2013-12-09 07:28:22,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16a50843 >2013-12-09 07:28:23,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 16a50843 >2013-12-09 07:28:23,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68dafa0a >2013-12-09 07:28:23,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68dafa0a >2013-12-09 07:28:28,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1dc03033 >2013-12-09 07:28:28,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1dc03033 >2013-12-09 07:28:28,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 250a1764 >2013-12-09 07:28:29,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 250a1764 >2013-12-09 07:28:34,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23a0fdb5 >2013-12-09 07:28:34,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 23a0fdb5 >2013-12-09 07:28:34,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a476c7 >2013-12-09 07:28:34,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a476c7 >2013-12-09 07:28:40,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5aa6537 >2013-12-09 07:28:40,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5aa6537 >2013-12-09 07:28:40,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d8df41e >2013-12-09 07:28:40,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d8df41e >2013-12-09 07:28:45,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56d96cf8 >2013-12-09 07:28:46,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 56d96cf8 >2013-12-09 07:28:46,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d271365 >2013-12-09 07:28:46,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d271365 >2013-12-09 07:28:51,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71a73ef4 >2013-12-09 07:28:52,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 71a73ef4 >2013-12-09 07:28:52,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57e83a17 >2013-12-09 07:28:52,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57e83a17 >2013-12-09 07:28:57,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59b813d0 >2013-12-09 07:28:57,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 59b813d0 >2013-12-09 07:28:57,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b941745 >2013-12-09 07:28:58,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b941745 >2013-12-09 07:29:03,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69dba146 >2013-12-09 07:29:03,609 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) No up server in cluster >2013-12-09 07:29:03,609 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:29:03,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3fd7f8c0 >2013-12-09 07:29:03,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 69dba146 >2013-12-09 07:29:03,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a8569de >2013-12-09 07:29:03,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3fd7f8c0 >2013-12-09 07:29:03,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a8569de >2013-12-09 07:29:08,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67f33339 >2013-12-09 07:29:09,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 67f33339 >2013-12-09 07:29:09,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41a098dc >2013-12-09 07:29:09,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41a098dc >2013-12-09 07:29:14,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 532c636f >2013-12-09 07:29:15,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 532c636f >2013-12-09 07:29:15,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4fc17c7f >2013-12-09 07:29:15,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fc17c7f >2013-12-09 07:29:20,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2843337d >2013-12-09 07:29:20,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2843337d >2013-12-09 07:29:20,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 563cdfa8 >2013-12-09 07:29:21,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 563cdfa8 >2013-12-09 07:29:26,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5132843c >2013-12-09 07:29:26,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5132843c >2013-12-09 07:29:26,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c97b870 >2013-12-09 07:29:26,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c97b870 >2013-12-09 07:29:31,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59b2d9c2 >2013-12-09 07:29:32,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59b2d9c2 >2013-12-09 07:29:32,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4851bdf7 >2013-12-09 07:29:32,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4851bdf7 >2013-12-09 07:29:37,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fd2ded5 >2013-12-09 07:29:38,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2fd2ded5 >2013-12-09 07:29:38,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e0fad04 >2013-12-09 07:29:38,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e0fad04 >2013-12-09 07:29:43,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e1c9774 >2013-12-09 07:29:44,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e1c9774 >2013-12-09 07:29:44,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a330b07 >2013-12-09 07:29:44,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a330b07 >2013-12-09 07:29:49,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 888f25e >2013-12-09 07:29:49,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 888f25e >2013-12-09 07:29:49,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 332c9f59 >2013-12-09 07:29:50,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 332c9f59 >2013-12-09 07:29:55,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 757639dc >2013-12-09 07:29:55,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 757639dc >2013-12-09 07:29:55,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26a3214c >2013-12-09 07:29:55,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26a3214c >2013-12-09 07:30:00,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5901915c >2013-12-09 07:30:01,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5901915c >2013-12-09 07:30:01,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46ed29c1 >2013-12-09 07:30:01,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46ed29c1 >2013-12-09 07:30:03,888 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-34) No up server in cluster >2013-12-09 07:30:03,888 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-34) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:30:03,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69238b29 >2013-12-09 07:30:04,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterTasksListVDSCommand, return: [], log id: 69238b29 >2013-12-09 07:30:06,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d134c7f >2013-12-09 07:30:07,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d134c7f >2013-12-09 07:30:07,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54d227ac >2013-12-09 07:30:07,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54d227ac >2013-12-09 07:30:12,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c90eb37 >2013-12-09 07:30:12,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c90eb37 >2013-12-09 07:30:12,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3632f0db >2013-12-09 07:30:13,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3632f0db >2013-12-09 07:30:18,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d6170eb >2013-12-09 07:30:18,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: d6170eb >2013-12-09 07:30:18,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c205ef5 >2013-12-09 07:30:18,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c205ef5 >2013-12-09 07:30:24,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ee8f21f >2013-12-09 07:30:24,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ee8f21f >2013-12-09 07:30:24,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32a4fb62 >2013-12-09 07:30:24,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32a4fb62 >2013-12-09 07:30:29,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2bb4eb84 >2013-12-09 07:30:30,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2bb4eb84 >2013-12-09 07:30:30,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e831aee >2013-12-09 07:30:30,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e831aee >2013-12-09 07:30:35,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6122a10e >2013-12-09 07:30:36,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6122a10e >2013-12-09 07:30:36,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bb15293 >2013-12-09 07:30:36,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4bb15293 >2013-12-09 07:30:41,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a3e5797 >2013-12-09 07:30:41,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4a3e5797 >2013-12-09 07:30:41,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 613fcc38 >2013-12-09 07:30:42,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 613fcc38 >2013-12-09 07:30:47,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 759a204d >2013-12-09 07:30:47,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 759a204d >2013-12-09 07:30:47,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 321ce69e >2013-12-09 07:30:47,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 321ce69e >2013-12-09 07:30:52,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62284884 >2013-12-09 07:30:53,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 62284884 >2013-12-09 07:30:53,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 538f1a08 >2013-12-09 07:30:53,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 538f1a08 >2013-12-09 07:30:58,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2057b511 >2013-12-09 07:30:59,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2057b511 >2013-12-09 07:30:59,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 494b6c58 >2013-12-09 07:30:59,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 494b6c58 >2013-12-09 07:31:04,162 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-19) No up server in cluster >2013-12-09 07:31:04,163 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-19) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:31:04,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29b61a52 >2013-12-09 07:31:04,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterTasksListVDSCommand, return: [], log id: 29b61a52 >2013-12-09 07:31:04,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3078f36e >2013-12-09 07:31:04,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3078f36e >2013-12-09 07:31:04,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ff62614 >2013-12-09 07:31:05,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ff62614 >2013-12-09 07:31:10,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4af463fe >2013-12-09 07:31:10,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4af463fe >2013-12-09 07:31:10,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 501e28d2 >2013-12-09 07:31:11,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 501e28d2 >2013-12-09 07:31:16,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 781adb34 >2013-12-09 07:31:16,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 781adb34 >2013-12-09 07:31:16,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 15139ce1 >2013-12-09 07:31:16,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15139ce1 >2013-12-09 07:31:21,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75b4442e >2013-12-09 07:31:22,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 75b4442e >2013-12-09 07:31:22,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3de563a6 >2013-12-09 07:31:22,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3de563a6 >2013-12-09 07:31:27,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43816b55 >2013-12-09 07:31:28,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 43816b55 >2013-12-09 07:31:28,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58276e70 >2013-12-09 07:31:28,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58276e70 >2013-12-09 07:31:33,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54768a30 >2013-12-09 07:31:33,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 54768a30 >2013-12-09 07:31:33,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6782bfa0 >2013-12-09 07:31:34,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6782bfa0 >2013-12-09 07:31:39,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54a59be1 >2013-12-09 07:31:39,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 54a59be1 >2013-12-09 07:31:39,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e81d4a0 >2013-12-09 07:31:39,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e81d4a0 >2013-12-09 07:31:44,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 241fe480 >2013-12-09 07:31:45,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 241fe480 >2013-12-09 07:31:45,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38633028 >2013-12-09 07:31:45,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38633028 >2013-12-09 07:31:50,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b13c488 >2013-12-09 07:31:51,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4b13c488 >2013-12-09 07:31:51,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4950d178 >2013-12-09 07:31:51,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4950d178 >2013-12-09 07:31:56,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5406241d >2013-12-09 07:31:57,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5406241d >2013-12-09 07:31:57,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4840f867 >2013-12-09 07:31:57,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4840f867 >2013-12-09 07:32:02,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3137808 >2013-12-09 07:32:02,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3137808 >2013-12-09 07:32:02,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 564d5aa7 >2013-12-09 07:32:03,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 564d5aa7 >2013-12-09 07:32:04,448 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-3) [6d1f044] No up server in cluster >2013-12-09 07:32:04,448 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-3) [6d1f044] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:32:04,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 85fdfed >2013-12-09 07:32:04,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterTasksListVDSCommand, return: [], log id: 85fdfed >2013-12-09 07:32:08,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 28440762 >2013-12-09 07:32:08,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 28440762 >2013-12-09 07:32:08,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71ec882e >2013-12-09 07:32:08,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71ec882e >2013-12-09 07:32:13,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15355d39 >2013-12-09 07:32:14,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 15355d39 >2013-12-09 07:32:14,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d8b7e6 >2013-12-09 07:32:14,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d8b7e6 >2013-12-09 07:32:19,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d82f026 >2013-12-09 07:32:20,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d82f026 >2013-12-09 07:32:20,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43cb62ad >2013-12-09 07:32:20,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43cb62ad >2013-12-09 07:32:25,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f03bfdb >2013-12-09 07:32:25,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: f03bfdb >2013-12-09 07:32:25,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 557ba7aa >2013-12-09 07:32:26,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 557ba7aa >2013-12-09 07:32:31,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3694bb50 >2013-12-09 07:32:31,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3694bb50 >2013-12-09 07:32:31,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1fedcd9a >2013-12-09 07:32:31,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1fedcd9a >2013-12-09 07:32:36,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3642d23e >2013-12-09 07:32:37,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3642d23e >2013-12-09 07:32:37,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a1799b2 >2013-12-09 07:32:37,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a1799b2 >2013-12-09 07:32:42,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 528bd4f2 >2013-12-09 07:32:43,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 528bd4f2 >2013-12-09 07:32:43,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39929ab2 >2013-12-09 07:32:43,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39929ab2 >2013-12-09 07:32:48,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a266aeb >2013-12-09 07:32:48,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a266aeb >2013-12-09 07:32:48,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f2116a >2013-12-09 07:32:49,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f2116a >2013-12-09 07:32:54,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70acbaed >2013-12-09 07:32:54,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 70acbaed >2013-12-09 07:32:54,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b04e42a >2013-12-09 07:32:55,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b04e42a >2013-12-09 07:33:00,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6dda72f7 >2013-12-09 07:33:00,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6dda72f7 >2013-12-09 07:33:00,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43e8d58b >2013-12-09 07:33:00,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43e8d58b >2013-12-09 07:33:04,756 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-13) No up server in cluster >2013-12-09 07:33:04,756 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-13) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:33:04,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37b7c7ac >2013-12-09 07:33:05,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterTasksListVDSCommand, return: [], log id: 37b7c7ac >2013-12-09 07:33:05,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76d02c64 >2013-12-09 07:33:06,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 76d02c64 >2013-12-09 07:33:06,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12a3be5b >2013-12-09 07:33:06,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12a3be5b >2013-12-09 07:33:11,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 780f55cf >2013-12-09 07:33:12,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 780f55cf >2013-12-09 07:33:12,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78ba2e6c >2013-12-09 07:33:12,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78ba2e6c >2013-12-09 07:33:17,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 293eef83 >2013-12-09 07:33:17,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 293eef83 >2013-12-09 07:33:17,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f257318 >2013-12-09 07:33:18,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f257318 >2013-12-09 07:33:23,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d0903e8 >2013-12-09 07:33:23,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: d0903e8 >2013-12-09 07:33:23,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7494e266 >2013-12-09 07:33:23,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7494e266 >2013-12-09 07:33:28,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20a3c6b3 >2013-12-09 07:33:29,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 20a3c6b3 >2013-12-09 07:33:29,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e8ba580 >2013-12-09 07:33:29,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e8ba580 >2013-12-09 07:33:34,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c3ec751 >2013-12-09 07:33:35,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1c3ec751 >2013-12-09 07:33:35,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b49c60c >2013-12-09 07:33:35,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b49c60c >2013-12-09 07:33:40,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bf72499 >2013-12-09 07:33:41,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4bf72499 >2013-12-09 07:33:41,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ca2828c >2013-12-09 07:33:41,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ca2828c >2013-12-09 07:33:46,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20415acb >2013-12-09 07:33:46,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 20415acb >2013-12-09 07:33:46,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e459249 >2013-12-09 07:33:47,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e459249 >2013-12-09 07:33:52,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e7158c1 >2013-12-09 07:33:52,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2e7158c1 >2013-12-09 07:33:52,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b879959 >2013-12-09 07:33:52,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b879959 >2013-12-09 07:33:57,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 615d32a1 >2013-12-09 07:33:58,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 615d32a1 >2013-12-09 07:33:58,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ef8262d >2013-12-09 07:33:58,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ef8262d >2013-12-09 07:34:03,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e818019 >2013-12-09 07:34:04,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e818019 >2013-12-09 07:34:04,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e7b678e >2013-12-09 07:34:04,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e7b678e >2013-12-09 07:34:05,046 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-60) No up server in cluster >2013-12-09 07:34:05,047 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-60) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:34:05,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 712e9ad9 >2013-12-09 07:34:05,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterTasksListVDSCommand, return: [], log id: 712e9ad9 >2013-12-09 07:34:09,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4dd4d762 >2013-12-09 07:34:09,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4dd4d762 >2013-12-09 07:34:09,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 328d072a >2013-12-09 07:34:10,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 328d072a >2013-12-09 07:34:15,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 944d085 >2013-12-09 07:34:15,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 944d085 >2013-12-09 07:34:15,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12d44e08 >2013-12-09 07:34:15,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12d44e08 >2013-12-09 07:34:20,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 533e13b3 >2013-12-09 07:34:21,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 533e13b3 >2013-12-09 07:34:21,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2375197d >2013-12-09 07:34:21,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2375197d >2013-12-09 07:34:26,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a992fb3 >2013-12-09 07:34:27,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a992fb3 >2013-12-09 07:34:27,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e7067d2 >2013-12-09 07:34:27,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e7067d2 >2013-12-09 07:34:32,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13a28e8f >2013-12-09 07:34:33,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 13a28e8f >2013-12-09 07:34:33,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5115667b >2013-12-09 07:34:33,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5115667b >2013-12-09 07:34:38,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f065185 >2013-12-09 07:34:38,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f065185 >2013-12-09 07:34:38,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 343dbb8b >2013-12-09 07:34:39,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 343dbb8b >2013-12-09 07:34:44,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 252336b3 >2013-12-09 07:34:44,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 252336b3 >2013-12-09 07:34:44,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ad4930f >2013-12-09 07:34:44,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ad4930f >2013-12-09 07:34:49,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41e5fbdd >2013-12-09 07:34:50,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 41e5fbdd >2013-12-09 07:34:50,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c487682 >2013-12-09 07:34:50,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c487682 >2013-12-09 07:34:55,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f3d1d74 >2013-12-09 07:34:56,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5f3d1d74 >2013-12-09 07:34:56,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 458b77c5 >2013-12-09 07:34:56,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 458b77c5 >2013-12-09 07:35:01,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a7db1f3 >2013-12-09 07:35:01,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3a7db1f3 >2013-12-09 07:35:01,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39ee208a >2013-12-09 07:35:02,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39ee208a >2013-12-09 07:35:05,328 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-59) No up server in cluster >2013-12-09 07:35:05,328 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-59) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:35:05,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30636879 >2013-12-09 07:35:05,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterTasksListVDSCommand, return: [], log id: 30636879 >2013-12-09 07:35:07,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 257ecae6 >2013-12-09 07:35:07,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 257ecae6 >2013-12-09 07:35:07,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c51655c >2013-12-09 07:35:07,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c51655c >2013-12-09 07:35:12,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d110ef9 >2013-12-09 07:35:13,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d110ef9 >2013-12-09 07:35:13,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35143f7a >2013-12-09 07:35:13,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35143f7a >2013-12-09 07:35:18,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1cd32a18 >2013-12-09 07:35:19,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1cd32a18 >2013-12-09 07:35:19,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27a1b345 >2013-12-09 07:35:19,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27a1b345 >2013-12-09 07:35:24,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5fa83d64 >2013-12-09 07:35:24,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5fa83d64 >2013-12-09 07:35:24,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 100902ed >2013-12-09 07:35:25,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 100902ed >2013-12-09 07:35:30,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1032eba0 >2013-12-09 07:35:30,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1032eba0 >2013-12-09 07:35:30,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d3f501f >2013-12-09 07:35:31,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d3f501f >2013-12-09 07:35:36,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23228df3 >2013-12-09 07:35:36,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 23228df3 >2013-12-09 07:35:36,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 211fa383 >2013-12-09 07:35:36,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 211fa383 >2013-12-09 07:35:41,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 378a50b8 >2013-12-09 07:35:42,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 378a50b8 >2013-12-09 07:35:42,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a500203 >2013-12-09 07:35:42,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a500203 >2013-12-09 07:35:47,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e928e26 >2013-12-09 07:35:48,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: e928e26 >2013-12-09 07:35:48,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 744445d8 >2013-12-09 07:35:48,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 744445d8 >2013-12-09 07:35:53,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ab59e43 >2013-12-09 07:35:53,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ab59e43 >2013-12-09 07:35:53,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ac33b92 >2013-12-09 07:35:54,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ac33b92 >2013-12-09 07:35:59,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64878d07 >2013-12-09 07:35:59,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 64878d07 >2013-12-09 07:35:59,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 526c5d45 >2013-12-09 07:35:59,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 526c5d45 >2013-12-09 07:36:04,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f2577fc >2013-12-09 07:36:05,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1f2577fc >2013-12-09 07:36:05,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12b1c566 >2013-12-09 07:36:05,616 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-88) No up server in cluster >2013-12-09 07:36:05,616 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-88) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:36:05,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3aafef1f >2013-12-09 07:36:05,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12b1c566 >2013-12-09 07:36:05,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3aafef1f >2013-12-09 07:36:10,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 238bd42 >2013-12-09 07:36:11,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 238bd42 >2013-12-09 07:36:11,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b126086 >2013-12-09 07:36:11,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b126086 >2013-12-09 07:36:16,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65543da1 >2013-12-09 07:36:16,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 65543da1 >2013-12-09 07:36:16,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 583e3443 >2013-12-09 07:36:17,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 583e3443 >2013-12-09 07:36:22,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20db3be6 >2013-12-09 07:36:22,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 20db3be6 >2013-12-09 07:36:22,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 178863f9 >2013-12-09 07:36:23,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 178863f9 >2013-12-09 07:36:28,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f8b0e2c >2013-12-09 07:36:28,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f8b0e2c >2013-12-09 07:36:28,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b95273f >2013-12-09 07:36:28,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b95273f >2013-12-09 07:36:33,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 246f4774 >2013-12-09 07:36:34,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 246f4774 >2013-12-09 07:36:34,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f4721f >2013-12-09 07:36:34,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f4721f >2013-12-09 07:36:39,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6377721d >2013-12-09 07:36:40,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6377721d >2013-12-09 07:36:40,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b424732 >2013-12-09 07:36:40,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b424732 >2013-12-09 07:36:45,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4367ff7d >2013-12-09 07:36:45,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4367ff7d >2013-12-09 07:36:45,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45b2f688 >2013-12-09 07:36:46,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45b2f688 >2013-12-09 07:36:51,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7776bebe >2013-12-09 07:36:51,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7776bebe >2013-12-09 07:36:51,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d13d0a3 >2013-12-09 07:36:51,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d13d0a3 >2013-12-09 07:36:56,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3091b9ad >2013-12-09 07:36:57,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3091b9ad >2013-12-09 07:36:57,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: cf4b34a >2013-12-09 07:36:57,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: cf4b34a >2013-12-09 07:37:02,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59dcb44a >2013-12-09 07:37:03,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59dcb44a >2013-12-09 07:37:03,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3399b7ab >2013-12-09 07:37:03,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3399b7ab >2013-12-09 07:37:05,894 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-52) No up server in cluster >2013-12-09 07:37:05,895 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-52) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:37:05,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bd23f65 >2013-12-09 07:37:06,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1bd23f65 >2013-12-09 07:37:08,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e43024f >2013-12-09 07:37:08,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: e43024f >2013-12-09 07:37:08,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1721803e >2013-12-09 07:37:09,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1721803e >2013-12-09 07:37:14,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 112dea26 >2013-12-09 07:37:14,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 112dea26 >2013-12-09 07:37:14,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1cdeb885 >2013-12-09 07:37:15,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1cdeb885 >2013-12-09 07:37:20,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 846528d >2013-12-09 07:37:20,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 846528d >2013-12-09 07:37:20,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 96dd0f9 >2013-12-09 07:37:20,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 96dd0f9 >2013-12-09 07:37:25,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3990f1f5 >2013-12-09 07:37:26,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3990f1f5 >2013-12-09 07:37:26,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8c3fb22 >2013-12-09 07:37:26,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8c3fb22 >2013-12-09 07:37:31,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c446422 >2013-12-09 07:37:32,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c446422 >2013-12-09 07:37:32,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4161f35b >2013-12-09 07:37:32,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4161f35b >2013-12-09 07:37:37,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3bf77761 >2013-12-09 07:37:37,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3bf77761 >2013-12-09 07:37:37,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6bcba465 >2013-12-09 07:37:38,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6bcba465 >2013-12-09 07:37:43,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 491994af >2013-12-09 07:37:43,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 491994af >2013-12-09 07:37:43,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4073e819 >2013-12-09 07:37:43,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4073e819 >2013-12-09 07:37:48,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a24a6a7 >2013-12-09 07:37:49,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6a24a6a7 >2013-12-09 07:37:49,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46d2d1b1 >2013-12-09 07:37:49,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46d2d1b1 >2013-12-09 07:37:54,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b9d5e >2013-12-09 07:37:55,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b9d5e >2013-12-09 07:37:55,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79159cf5 >2013-12-09 07:37:55,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79159cf5 >2013-12-09 07:38:00,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 583129e0 >2013-12-09 07:38:01,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 583129e0 >2013-12-09 07:38:01,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ba41d71 >2013-12-09 07:38:01,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ba41d71 >2013-12-09 07:38:06,177 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-98) No up server in cluster >2013-12-09 07:38:06,178 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-98) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:38:06,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d5daa57 >2013-12-09 07:38:06,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43e39f56 >2013-12-09 07:38:06,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7d5daa57 >2013-12-09 07:38:06,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 43e39f56 >2013-12-09 07:38:06,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58570c33 >2013-12-09 07:38:07,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58570c33 >2013-12-09 07:38:12,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 415d1eb >2013-12-09 07:38:12,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 415d1eb >2013-12-09 07:38:12,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58755ccc >2013-12-09 07:38:12,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58755ccc >2013-12-09 07:38:17,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66eccbb7 >2013-12-09 07:38:18,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 66eccbb7 >2013-12-09 07:38:18,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ad82a4a >2013-12-09 07:38:18,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ad82a4a >2013-12-09 07:38:23,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79da4ded >2013-12-09 07:38:24,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 79da4ded >2013-12-09 07:38:24,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5bc77033 >2013-12-09 07:38:24,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5bc77033 >2013-12-09 07:38:29,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f907637 >2013-12-09 07:38:29,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5f907637 >2013-12-09 07:38:29,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41ab1758 >2013-12-09 07:38:30,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41ab1758 >2013-12-09 07:38:35,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 754f685e >2013-12-09 07:38:35,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 754f685e >2013-12-09 07:38:35,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2eef3e2a >2013-12-09 07:38:36,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2eef3e2a >2013-12-09 07:38:41,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c906330 >2013-12-09 07:38:41,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c906330 >2013-12-09 07:38:41,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c566caf >2013-12-09 07:38:41,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c566caf >2013-12-09 07:38:46,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 728a8bc2 >2013-12-09 07:38:47,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 728a8bc2 >2013-12-09 07:38:47,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a401717 >2013-12-09 07:38:47,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a401717 >2013-12-09 07:38:52,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 389fc545 >2013-12-09 07:38:53,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 389fc545 >2013-12-09 07:38:53,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f4481c3 >2013-12-09 07:38:53,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f4481c3 >2013-12-09 07:38:58,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 386d76e8 >2013-12-09 07:38:58,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 386d76e8 >2013-12-09 07:38:58,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68267679 >2013-12-09 07:38:59,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68267679 >2013-12-09 07:39:04,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6407de19 >2013-12-09 07:39:04,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6407de19 >2013-12-09 07:39:04,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a59af71 >2013-12-09 07:39:04,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a59af71 >2013-12-09 07:39:06,476 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-31) No up server in cluster >2013-12-09 07:39:06,476 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-31) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:39:06,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d9f6bb0 >2013-12-09 07:39:06,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6d9f6bb0 >2013-12-09 07:39:09,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5fb071a0 >2013-12-09 07:39:10,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5fb071a0 >2013-12-09 07:39:10,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: dc9540c >2013-12-09 07:39:10,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: dc9540c >2013-12-09 07:39:15,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5cccbe >2013-12-09 07:39:16,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5cccbe >2013-12-09 07:39:16,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59a84868 >2013-12-09 07:39:16,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59a84868 >2013-12-09 07:39:21,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e71f1eb >2013-12-09 07:39:21,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7e71f1eb >2013-12-09 07:39:21,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7dc964d5 >2013-12-09 07:39:22,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7dc964d5 >2013-12-09 07:39:27,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27b4cb45 >2013-12-09 07:39:27,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 27b4cb45 >2013-12-09 07:39:27,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78399b2d >2013-12-09 07:39:28,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78399b2d >2013-12-09 07:39:33,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2cc38554 >2013-12-09 07:39:33,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2cc38554 >2013-12-09 07:39:33,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ff33b2e >2013-12-09 07:39:33,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ff33b2e >2013-12-09 07:39:38,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b4d624c >2013-12-09 07:39:39,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4b4d624c >2013-12-09 07:39:39,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50a00ad7 >2013-12-09 07:39:39,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50a00ad7 >2013-12-09 07:39:44,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1fb65a31 >2013-12-09 07:39:45,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1fb65a31 >2013-12-09 07:39:45,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f4a0f4b >2013-12-09 07:39:45,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f4a0f4b >2013-12-09 07:39:50,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6fdb75b3 >2013-12-09 07:39:50,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6fdb75b3 >2013-12-09 07:39:50,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 149ee7bf >2013-12-09 07:39:51,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 149ee7bf >2013-12-09 07:39:56,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1fb7ed35 >2013-12-09 07:39:56,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1fb7ed35 >2013-12-09 07:39:56,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20a0d031 >2013-12-09 07:39:56,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20a0d031 >2013-12-09 07:40:01,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 300e11d2 >2013-12-09 07:40:02,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 300e11d2 >2013-12-09 07:40:02,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a2b1ac9 >2013-12-09 07:40:02,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a2b1ac9 >2013-12-09 07:40:06,744 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-96) No up server in cluster >2013-12-09 07:40:06,744 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-96) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:40:06,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27597c35 >2013-12-09 07:40:07,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterTasksListVDSCommand, return: [], log id: 27597c35 >2013-12-09 07:40:07,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67c49381 >2013-12-09 07:40:08,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 67c49381 >2013-12-09 07:40:08,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f101a49 >2013-12-09 07:40:08,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f101a49 >2013-12-09 07:40:13,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56de4ebb >2013-12-09 07:40:13,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 56de4ebb >2013-12-09 07:40:13,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48169731 >2013-12-09 07:40:14,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48169731 >2013-12-09 07:40:19,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17e3312 >2013-12-09 07:40:19,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 17e3312 >2013-12-09 07:40:19,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2aee1a3 >2013-12-09 07:40:20,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2aee1a3 >2013-12-09 07:40:25,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 676fbdaa >2013-12-09 07:40:25,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 676fbdaa >2013-12-09 07:40:25,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4329211b >2013-12-09 07:40:25,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4329211b >2013-12-09 07:40:30,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18a3b221 >2013-12-09 07:40:31,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 18a3b221 >2013-12-09 07:40:31,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21ce95a1 >2013-12-09 07:40:31,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21ce95a1 >2013-12-09 07:40:36,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36bf1b7c >2013-12-09 07:40:37,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 36bf1b7c >2013-12-09 07:40:37,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6509baf6 >2013-12-09 07:40:37,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6509baf6 >2013-12-09 07:40:42,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7283cb9f >2013-12-09 07:40:42,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7283cb9f >2013-12-09 07:40:42,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69e69b51 >2013-12-09 07:40:43,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69e69b51 >2013-12-09 07:40:48,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32387cd0 >2013-12-09 07:40:48,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 32387cd0 >2013-12-09 07:40:48,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5121a8a9 >2013-12-09 07:40:48,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5121a8a9 >2013-12-09 07:40:53,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f197bbe >2013-12-09 07:40:54,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: f197bbe >2013-12-09 07:40:54,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 166e3a59 >2013-12-09 07:40:54,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 166e3a59 >2013-12-09 07:40:59,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f5e8b9d >2013-12-09 07:41:00,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f5e8b9d >2013-12-09 07:41:00,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 306d8b49 >2013-12-09 07:41:00,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 306d8b49 >2013-12-09 07:41:05,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40353aa1 >2013-12-09 07:41:06,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 40353aa1 >2013-12-09 07:41:06,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f56f58f >2013-12-09 07:41:06,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f56f58f >2013-12-09 07:41:07,021 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-34) No up server in cluster >2013-12-09 07:41:07,021 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-34) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:41:07,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79763de8 >2013-12-09 07:41:07,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterTasksListVDSCommand, return: [], log id: 79763de8 >2013-12-09 07:41:11,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 329e8606 >2013-12-09 07:41:11,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 329e8606 >2013-12-09 07:41:11,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8eea537 >2013-12-09 07:41:12,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8eea537 >2013-12-09 07:41:17,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42bbc5e2 >2013-12-09 07:41:17,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 42bbc5e2 >2013-12-09 07:41:17,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61282190 >2013-12-09 07:41:17,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61282190 >2013-12-09 07:41:22,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ec73e00 >2013-12-09 07:41:23,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ec73e00 >2013-12-09 07:41:23,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e70d4a5 >2013-12-09 07:41:23,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e70d4a5 >2013-12-09 07:41:28,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 790aca35 >2013-12-09 07:41:29,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 790aca35 >2013-12-09 07:41:29,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 317ec7d3 >2013-12-09 07:41:29,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 317ec7d3 >2013-12-09 07:41:34,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ddf2b38 >2013-12-09 07:41:34,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6ddf2b38 >2013-12-09 07:41:34,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 275f23a7 >2013-12-09 07:41:35,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 275f23a7 >2013-12-09 07:41:40,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 440bbe0c >2013-12-09 07:41:40,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 440bbe0c >2013-12-09 07:41:40,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 530a9798 >2013-12-09 07:41:40,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 530a9798 >2013-12-09 07:41:45,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4629cbcd >2013-12-09 07:41:46,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4629cbcd >2013-12-09 07:41:46,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b513102 >2013-12-09 07:41:46,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b513102 >2013-12-09 07:41:51,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b904493 >2013-12-09 07:41:52,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b904493 >2013-12-09 07:41:52,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 543df5a >2013-12-09 07:41:52,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 543df5a >2013-12-09 07:41:57,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6dcfbd73 >2013-12-09 07:41:58,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6dcfbd73 >2013-12-09 07:41:58,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fc19f93 >2013-12-09 07:41:58,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fc19f93 >2013-12-09 07:42:03,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: bc15044 >2013-12-09 07:42:03,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: bc15044 >2013-12-09 07:42:03,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20f2fd27 >2013-12-09 07:42:04,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20f2fd27 >2013-12-09 07:42:07,309 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-47) No up server in cluster >2013-12-09 07:42:07,309 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-47) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:42:07,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27801a5c >2013-12-09 07:42:07,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterTasksListVDSCommand, return: [], log id: 27801a5c >2013-12-09 07:42:09,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d93d758 >2013-12-09 07:42:09,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4d93d758 >2013-12-09 07:42:09,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 49b7ffb3 >2013-12-09 07:42:09,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49b7ffb3 >2013-12-09 07:42:14,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3eb0060b >2013-12-09 07:42:15,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3eb0060b >2013-12-09 07:42:15,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51adf690 >2013-12-09 07:42:15,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51adf690 >2013-12-09 07:42:20,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f772a7b >2013-12-09 07:42:21,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3f772a7b >2013-12-09 07:42:21,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e19b6cb >2013-12-09 07:42:21,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e19b6cb >2013-12-09 07:42:26,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f11b3fa >2013-12-09 07:42:26,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f11b3fa >2013-12-09 07:42:26,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e554f3e >2013-12-09 07:42:27,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e554f3e >2013-12-09 07:42:32,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1685e750 >2013-12-09 07:42:32,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1685e750 >2013-12-09 07:42:32,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 764563db >2013-12-09 07:42:32,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 764563db >2013-12-09 07:42:38,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e1dd893 >2013-12-09 07:42:38,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1e1dd893 >2013-12-09 07:42:38,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35aec6d0 >2013-12-09 07:42:38,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35aec6d0 >2013-12-09 07:42:43,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f6237c4 >2013-12-09 07:42:44,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5f6237c4 >2013-12-09 07:42:44,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7dd2d53f >2013-12-09 07:42:44,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7dd2d53f >2013-12-09 07:42:49,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e43671 >2013-12-09 07:42:50,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e43671 >2013-12-09 07:42:50,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 775ad43e >2013-12-09 07:42:50,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 775ad43e >2013-12-09 07:42:55,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26aac4a9 >2013-12-09 07:42:55,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 26aac4a9 >2013-12-09 07:42:55,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7bd819c2 >2013-12-09 07:42:56,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7bd819c2 >2013-12-09 07:43:01,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2bdd9165 >2013-12-09 07:43:01,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2bdd9165 >2013-12-09 07:43:01,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 689e81e8 >2013-12-09 07:43:01,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 689e81e8 >2013-12-09 07:43:06,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42f35b3e >2013-12-09 07:43:07,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 42f35b3e >2013-12-09 07:43:07,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42a877fb >2013-12-09 07:43:07,596 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) No up server in cluster >2013-12-09 07:43:07,596 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:43:07,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f0e794e >2013-12-09 07:43:07,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42a877fb >2013-12-09 07:43:07,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3f0e794e >2013-12-09 07:43:12,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70243dc >2013-12-09 07:43:13,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 70243dc >2013-12-09 07:43:13,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 683aef65 >2013-12-09 07:43:13,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 683aef65 >2013-12-09 07:43:18,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 24cb4206 >2013-12-09 07:43:18,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 24cb4206 >2013-12-09 07:43:18,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 766710d8 >2013-12-09 07:43:19,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 766710d8 >2013-12-09 07:43:24,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f7befc6 >2013-12-09 07:43:24,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f7befc6 >2013-12-09 07:43:24,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a4bc752 >2013-12-09 07:43:25,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a4bc752 >2013-12-09 07:43:30,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2fa1745a >2013-12-09 07:43:30,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2fa1745a >2013-12-09 07:43:30,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 658e89b4 >2013-12-09 07:43:30,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 658e89b4 >2013-12-09 07:43:35,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 732bdd2a >2013-12-09 07:43:36,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 732bdd2a >2013-12-09 07:43:36,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d5e08e7 >2013-12-09 07:43:36,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d5e08e7 >2013-12-09 07:43:41,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 358db3ab >2013-12-09 07:43:42,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 358db3ab >2013-12-09 07:43:42,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b0812d3 >2013-12-09 07:43:42,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b0812d3 >2013-12-09 07:43:47,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4310b0f5 >2013-12-09 07:43:47,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4310b0f5 >2013-12-09 07:43:47,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19e838f1 >2013-12-09 07:43:48,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19e838f1 >2013-12-09 07:43:53,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69aea92d >2013-12-09 07:43:53,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 69aea92d >2013-12-09 07:43:53,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c76c0bb >2013-12-09 07:43:53,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c76c0bb >2013-12-09 07:43:58,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64381696 >2013-12-09 07:43:59,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 64381696 >2013-12-09 07:43:59,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14fdb359 >2013-12-09 07:43:59,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14fdb359 >2013-12-09 07:44:04,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41f58f52 >2013-12-09 07:44:05,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 41f58f52 >2013-12-09 07:44:05,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 594833bf >2013-12-09 07:44:05,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 594833bf >2013-12-09 07:44:07,875 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-36) No up server in cluster >2013-12-09 07:44:07,875 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-36) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:44:07,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36b0830 >2013-12-09 07:44:08,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterTasksListVDSCommand, return: [], log id: 36b0830 >2013-12-09 07:44:10,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10189c5d >2013-12-09 07:44:11,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 10189c5d >2013-12-09 07:44:11,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 659d228f >2013-12-09 07:44:11,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 659d228f >2013-12-09 07:44:16,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6377861 >2013-12-09 07:44:16,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6377861 >2013-12-09 07:44:16,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7784425e >2013-12-09 07:44:17,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7784425e >2013-12-09 07:44:22,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76fdbaf6 >2013-12-09 07:44:22,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 76fdbaf6 >2013-12-09 07:44:22,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14262ef4 >2013-12-09 07:44:22,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14262ef4 >2013-12-09 07:44:27,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39e5c44c >2013-12-09 07:44:28,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 39e5c44c >2013-12-09 07:44:28,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bfb07b0 >2013-12-09 07:44:28,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4bfb07b0 >2013-12-09 07:44:33,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 289aa30b >2013-12-09 07:44:34,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 289aa30b >2013-12-09 07:44:34,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 570f0161 >2013-12-09 07:44:34,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 570f0161 >2013-12-09 07:44:39,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 82961b1 >2013-12-09 07:44:39,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 82961b1 >2013-12-09 07:44:39,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7dfe145a >2013-12-09 07:44:40,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7dfe145a >2013-12-09 07:44:45,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57477876 >2013-12-09 07:44:45,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 57477876 >2013-12-09 07:44:45,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ddbb49e >2013-12-09 07:44:45,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ddbb49e >2013-12-09 07:44:50,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a8b3a4c >2013-12-09 07:44:51,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a8b3a4c >2013-12-09 07:44:51,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b416e37 >2013-12-09 07:44:51,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b416e37 >2013-12-09 07:44:56,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6cef8d36 >2013-12-09 07:44:57,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6cef8d36 >2013-12-09 07:44:57,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f5c2bcd >2013-12-09 07:44:57,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f5c2bcd >2013-12-09 07:45:02,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32509d61 >2013-12-09 07:45:02,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 32509d61 >2013-12-09 07:45:02,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ce04577 >2013-12-09 07:45:03,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ce04577 >2013-12-09 07:45:08,154 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-23) No up server in cluster >2013-12-09 07:45:08,155 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-23) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:45:08,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57611848 >2013-12-09 07:45:08,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: dfdebfb >2013-12-09 07:45:08,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterTasksListVDSCommand, return: [], log id: 57611848 >2013-12-09 07:45:08,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: dfdebfb >2013-12-09 07:45:08,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35442734 >2013-12-09 07:45:09,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35442734 >2013-12-09 07:45:14,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59eeabb5 >2013-12-09 07:45:14,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59eeabb5 >2013-12-09 07:45:14,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e7b99e5 >2013-12-09 07:45:14,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e7b99e5 >2013-12-09 07:45:19,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2462fd9f >2013-12-09 07:45:20,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2462fd9f >2013-12-09 07:45:20,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29b6cab >2013-12-09 07:45:20,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29b6cab >2013-12-09 07:45:25,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39fea8a >2013-12-09 07:45:26,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 39fea8a >2013-12-09 07:45:26,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8f0492 >2013-12-09 07:45:26,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8f0492 >2013-12-09 07:45:31,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73242ef >2013-12-09 07:45:31,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 73242ef >2013-12-09 07:45:31,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73ffd0c0 >2013-12-09 07:45:32,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73ffd0c0 >2013-12-09 07:45:37,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b6b9120 >2013-12-09 07:45:37,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5b6b9120 >2013-12-09 07:45:37,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e0fff98 >2013-12-09 07:45:37,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e0fff98 >2013-12-09 07:45:42,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 215d2678 >2013-12-09 07:45:43,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 215d2678 >2013-12-09 07:45:43,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9adcc54 >2013-12-09 07:45:43,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9adcc54 >2013-12-09 07:45:48,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d7a5d60 >2013-12-09 07:45:49,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4d7a5d60 >2013-12-09 07:45:49,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47f01925 >2013-12-09 07:45:49,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47f01925 >2013-12-09 07:45:54,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53b15bbc >2013-12-09 07:45:55,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 53b15bbc >2013-12-09 07:45:55,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63e7f33b >2013-12-09 07:45:55,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63e7f33b >2013-12-09 07:46:00,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 327d3632 >2013-12-09 07:46:00,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 327d3632 >2013-12-09 07:46:00,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70b5560f >2013-12-09 07:46:01,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70b5560f >2013-12-09 07:46:06,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7543a388 >2013-12-09 07:46:06,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7543a388 >2013-12-09 07:46:06,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 433d849a >2013-12-09 07:46:06,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 433d849a >2013-12-09 07:46:08,405 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-87) No up server in cluster >2013-12-09 07:46:08,406 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-87) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:46:08,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 586e86ad >2013-12-09 07:46:08,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterTasksListVDSCommand, return: [], log id: 586e86ad >2013-12-09 07:46:11,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59d2b06c >2013-12-09 07:46:12,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59d2b06c >2013-12-09 07:46:12,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c45b977 >2013-12-09 07:46:12,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c45b977 >2013-12-09 07:46:17,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52781724 >2013-12-09 07:46:18,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 52781724 >2013-12-09 07:46:18,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: aa0d7fb >2013-12-09 07:46:18,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: aa0d7fb >2013-12-09 07:46:23,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ab5d89f >2013-12-09 07:46:23,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3ab5d89f >2013-12-09 07:46:23,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65d0ee2d >2013-12-09 07:46:24,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65d0ee2d >2013-12-09 07:46:29,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 183085fd >2013-12-09 07:46:29,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 183085fd >2013-12-09 07:46:29,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10605ca6 >2013-12-09 07:46:29,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10605ca6 >2013-12-09 07:46:34,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7767c0dc >2013-12-09 07:46:35,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7767c0dc >2013-12-09 07:46:35,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 49c3e86b >2013-12-09 07:46:35,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49c3e86b >2013-12-09 07:46:40,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2596d35e >2013-12-09 07:46:41,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2596d35e >2013-12-09 07:46:41,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2cb9aa6b >2013-12-09 07:46:41,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2cb9aa6b >2013-12-09 07:46:46,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e7696e4 >2013-12-09 07:46:47,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2e7696e4 >2013-12-09 07:46:47,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2584bc5d >2013-12-09 07:46:47,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2584bc5d >2013-12-09 07:46:52,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ccc02f0 >2013-12-09 07:46:52,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ccc02f0 >2013-12-09 07:46:52,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c01b5c7 >2013-12-09 07:46:53,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c01b5c7 >2013-12-09 07:46:58,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a19a04e >2013-12-09 07:46:58,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a19a04e >2013-12-09 07:46:58,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 688ebff5 >2013-12-09 07:46:58,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 688ebff5 >2013-12-09 07:47:03,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c4ff90b >2013-12-09 07:47:04,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: c4ff90b >2013-12-09 07:47:04,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5cdb087 >2013-12-09 07:47:04,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cdb087 >2013-12-09 07:47:08,691 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-100) No up server in cluster >2013-12-09 07:47:08,691 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-100) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:47:08,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b304548 >2013-12-09 07:47:08,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6b304548 >2013-12-09 07:47:09,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 44b4ec6d >2013-12-09 07:47:10,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 44b4ec6d >2013-12-09 07:47:10,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ef24612 >2013-12-09 07:47:10,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ef24612 >2013-12-09 07:47:15,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a9151bf >2013-12-09 07:47:15,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a9151bf >2013-12-09 07:47:15,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5df43a38 >2013-12-09 07:47:16,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5df43a38 >2013-12-09 07:47:21,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64eb7a6b >2013-12-09 07:47:21,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 64eb7a6b >2013-12-09 07:47:21,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5232b698 >2013-12-09 07:47:21,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5232b698 >2013-12-09 07:47:27,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62ff7198 >2013-12-09 07:47:27,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 62ff7198 >2013-12-09 07:47:27,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7424f5a8 >2013-12-09 07:47:27,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7424f5a8 >2013-12-09 07:47:32,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5853bd27 >2013-12-09 07:47:33,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5853bd27 >2013-12-09 07:47:33,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: af88d8 >2013-12-09 07:47:33,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: af88d8 >2013-12-09 07:47:38,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78035e83 >2013-12-09 07:47:39,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 78035e83 >2013-12-09 07:47:39,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 796639f >2013-12-09 07:47:39,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 796639f >2013-12-09 07:47:44,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11d8a166 >2013-12-09 07:47:44,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 11d8a166 >2013-12-09 07:47:44,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20b467e3 >2013-12-09 07:47:45,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20b467e3 >2013-12-09 07:47:50,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 353eadba >2013-12-09 07:47:50,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 353eadba >2013-12-09 07:47:50,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 717da88d >2013-12-09 07:47:50,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 717da88d >2013-12-09 07:47:55,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 85043c2 >2013-12-09 07:47:56,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 85043c2 >2013-12-09 07:47:56,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e6687d9 >2013-12-09 07:47:56,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e6687d9 >2013-12-09 07:48:01,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65cb3d86 >2013-12-09 07:48:02,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 65cb3d86 >2013-12-09 07:48:02,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b4b8c47 >2013-12-09 07:48:02,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b4b8c47 >2013-12-09 07:48:07,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13428ca >2013-12-09 07:48:07,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 13428ca >2013-12-09 07:48:07,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1496494a >2013-12-09 07:48:08,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1496494a >2013-12-09 07:48:08,976 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-22) No up server in cluster >2013-12-09 07:48:08,976 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-22) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:48:08,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23274734 >2013-12-09 07:48:09,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterTasksListVDSCommand, return: [], log id: 23274734 >2013-12-09 07:48:13,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75609acb >2013-12-09 07:48:13,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 75609acb >2013-12-09 07:48:13,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 453bf2b0 >2013-12-09 07:48:14,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 453bf2b0 >2013-12-09 07:48:19,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e505a2 >2013-12-09 07:48:19,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: e505a2 >2013-12-09 07:48:19,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43974a6d >2013-12-09 07:48:19,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43974a6d >2013-12-09 07:48:24,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23b0537b >2013-12-09 07:48:25,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 23b0537b >2013-12-09 07:48:25,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 467eb0b9 >2013-12-09 07:48:25,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 467eb0b9 >2013-12-09 07:48:30,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16d27551 >2013-12-09 07:48:31,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 16d27551 >2013-12-09 07:48:31,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2bbbbab >2013-12-09 07:48:31,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bbbbab >2013-12-09 07:48:36,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21d085ff >2013-12-09 07:48:36,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 21d085ff >2013-12-09 07:48:36,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6dc77a94 >2013-12-09 07:48:37,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6dc77a94 >2013-12-09 07:48:42,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 44ec74b >2013-12-09 07:48:42,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 44ec74b >2013-12-09 07:48:42,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ceba1ea >2013-12-09 07:48:42,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ceba1ea >2013-12-09 07:48:47,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bc505e4 >2013-12-09 07:48:48,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2bc505e4 >2013-12-09 07:48:48,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 295396f6 >2013-12-09 07:48:48,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 295396f6 >2013-12-09 07:48:53,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6aaaed5f >2013-12-09 07:48:54,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6aaaed5f >2013-12-09 07:48:54,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5eae78d7 >2013-12-09 07:48:54,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5eae78d7 >2013-12-09 07:48:59,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3333864c >2013-12-09 07:48:59,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3333864c >2013-12-09 07:48:59,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 556403ae >2013-12-09 07:49:00,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 556403ae >2013-12-09 07:49:05,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41db4b85 >2013-12-09 07:49:05,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 41db4b85 >2013-12-09 07:49:05,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d37dd39 >2013-12-09 07:49:05,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d37dd39 >2013-12-09 07:49:09,246 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-75) No up server in cluster >2013-12-09 07:49:09,246 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-75) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:49:09,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5063f13f >2013-12-09 07:49:09,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5063f13f >2013-12-09 07:49:10,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8bbcfb1 >2013-12-09 07:49:11,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 8bbcfb1 >2013-12-09 07:49:11,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b052b2d >2013-12-09 07:49:11,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b052b2d >2013-12-09 07:49:16,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1cf1333 >2013-12-09 07:49:17,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1cf1333 >2013-12-09 07:49:17,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4af26790 >2013-12-09 07:49:17,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4af26790 >2013-12-09 07:49:22,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72c4bcc2 >2013-12-09 07:49:23,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 72c4bcc2 >2013-12-09 07:49:23,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5eb53dfb >2013-12-09 07:49:23,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5eb53dfb >2013-12-09 07:49:28,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b8cff7a >2013-12-09 07:49:28,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b8cff7a >2013-12-09 07:49:28,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5215a57a >2013-12-09 07:49:29,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5215a57a >2013-12-09 07:49:34,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68a2ea0a >2013-12-09 07:49:34,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 68a2ea0a >2013-12-09 07:49:34,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ade16d7 >2013-12-09 07:49:34,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ade16d7 >2013-12-09 07:49:39,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: cacb27d >2013-12-09 07:49:40,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: cacb27d >2013-12-09 07:49:40,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a86f3b >2013-12-09 07:49:40,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a86f3b >2013-12-09 07:49:45,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10978391 >2013-12-09 07:49:46,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 10978391 >2013-12-09 07:49:46,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b06f59d >2013-12-09 07:49:46,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b06f59d >2013-12-09 07:49:51,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e69de6f >2013-12-09 07:49:51,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: e69de6f >2013-12-09 07:49:51,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 22e6884f >2013-12-09 07:49:52,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22e6884f >2013-12-09 07:49:57,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 790740d0 >2013-12-09 07:49:57,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 790740d0 >2013-12-09 07:49:57,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42a8143b >2013-12-09 07:49:57,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42a8143b >2013-12-09 07:50:03,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6fc8a552 >2013-12-09 07:50:03,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6fc8a552 >2013-12-09 07:50:03,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69c1884b >2013-12-09 07:50:03,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69c1884b >2013-12-09 07:50:08,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 726c84b6 >2013-12-09 07:50:09,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 726c84b6 >2013-12-09 07:50:09,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 245ac87f >2013-12-09 07:50:09,536 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-89) No up server in cluster >2013-12-09 07:50:09,536 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-89) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:50:09,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e1730b7 >2013-12-09 07:50:09,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 245ac87f >2013-12-09 07:50:09,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4e1730b7 >2013-12-09 07:50:14,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 285f0e08 >2013-12-09 07:50:15,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 285f0e08 >2013-12-09 07:50:15,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ad33a0b >2013-12-09 07:50:15,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ad33a0b >2013-12-09 07:50:20,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b03af04 >2013-12-09 07:50:20,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b03af04 >2013-12-09 07:50:20,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5db2db4e >2013-12-09 07:50:21,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5db2db4e >2013-12-09 07:50:26,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ae1925e >2013-12-09 07:50:26,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ae1925e >2013-12-09 07:50:26,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 518b9cc >2013-12-09 07:50:26,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 518b9cc >2013-12-09 07:50:32,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 490d6559 >2013-12-09 07:50:32,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 490d6559 >2013-12-09 07:50:32,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ee8ef9c >2013-12-09 07:50:32,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ee8ef9c >2013-12-09 07:50:37,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 86c9f0e >2013-12-09 07:50:38,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 86c9f0e >2013-12-09 07:50:38,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29ffd689 >2013-12-09 07:50:38,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29ffd689 >2013-12-09 07:50:43,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6cdab482 >2013-12-09 07:50:44,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6cdab482 >2013-12-09 07:50:44,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1fa122cb >2013-12-09 07:50:44,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1fa122cb >2013-12-09 07:50:49,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2407f0a5 >2013-12-09 07:50:49,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2407f0a5 >2013-12-09 07:50:49,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 748782bc >2013-12-09 07:50:50,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 748782bc >2013-12-09 07:50:55,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f4556ac >2013-12-09 07:50:55,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f4556ac >2013-12-09 07:50:55,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e5b4d6e >2013-12-09 07:50:55,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e5b4d6e >2013-12-09 07:51:00,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e3a9ff9 >2013-12-09 07:51:01,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e3a9ff9 >2013-12-09 07:51:01,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d8b2262 >2013-12-09 07:51:01,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d8b2262 >2013-12-09 07:51:06,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 161ef901 >2013-12-09 07:51:07,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 161ef901 >2013-12-09 07:51:07,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33860d39 >2013-12-09 07:51:07,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33860d39 >2013-12-09 07:51:09,828 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-60) No up server in cluster >2013-12-09 07:51:09,828 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-60) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:51:09,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6168b1d5 >2013-12-09 07:51:10,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6168b1d5 >2013-12-09 07:51:12,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5da6d27b >2013-12-09 07:51:13,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5da6d27b >2013-12-09 07:51:13,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36c8733c >2013-12-09 07:51:13,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36c8733c >2013-12-09 07:51:18,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2751b1cc >2013-12-09 07:51:18,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2751b1cc >2013-12-09 07:51:18,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a323ba9 >2013-12-09 07:51:19,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a323ba9 >2013-12-09 07:51:24,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54ab7f0f >2013-12-09 07:51:24,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 54ab7f0f >2013-12-09 07:51:24,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53516236 >2013-12-09 07:51:24,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53516236 >2013-12-09 07:51:29,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58ce36bb >2013-12-09 07:51:30,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 58ce36bb >2013-12-09 07:51:30,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3eaee453 >2013-12-09 07:51:30,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3eaee453 >2013-12-09 07:51:35,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1aa3853 >2013-12-09 07:51:36,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1aa3853 >2013-12-09 07:51:36,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54ce9f7a >2013-12-09 07:51:36,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54ce9f7a >2013-12-09 07:51:41,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3293df74 >2013-12-09 07:51:41,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3293df74 >2013-12-09 07:51:41,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c8d8a1f >2013-12-09 07:51:42,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c8d8a1f >2013-12-09 07:51:47,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69588cf8 >2013-12-09 07:51:47,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 69588cf8 >2013-12-09 07:51:47,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5dfd7205 >2013-12-09 07:51:47,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5dfd7205 >2013-12-09 07:51:52,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14d37d57 >2013-12-09 07:51:53,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 14d37d57 >2013-12-09 07:51:53,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61c55d5d >2013-12-09 07:51:53,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61c55d5d >2013-12-09 07:51:58,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78e4a99d >2013-12-09 07:51:59,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 78e4a99d >2013-12-09 07:51:59,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 400f6f3 >2013-12-09 07:51:59,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 400f6f3 >2013-12-09 07:52:04,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 479540a0 >2013-12-09 07:52:05,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 479540a0 >2013-12-09 07:52:05,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 664f6bd7 >2013-12-09 07:52:05,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 664f6bd7 >2013-12-09 07:52:10,117 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-59) No up server in cluster >2013-12-09 07:52:10,117 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-59) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:52:10,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b5daff4 >2013-12-09 07:52:10,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2cb4dc1 >2013-12-09 07:52:10,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5b5daff4 >2013-12-09 07:52:10,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2cb4dc1 >2013-12-09 07:52:10,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e157c0d >2013-12-09 07:52:11,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e157c0d >2013-12-09 07:52:16,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 347bea11 >2013-12-09 07:52:16,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 347bea11 >2013-12-09 07:52:16,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2db63410 >2013-12-09 07:52:16,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2db63410 >2013-12-09 07:52:21,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b0b4b66 >2013-12-09 07:52:22,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b0b4b66 >2013-12-09 07:52:22,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6685063e >2013-12-09 07:52:22,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6685063e >2013-12-09 07:52:27,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a0b9ac0 >2013-12-09 07:52:28,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3a0b9ac0 >2013-12-09 07:52:28,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7735f1fe >2013-12-09 07:52:28,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7735f1fe >2013-12-09 07:52:33,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50df4ff1 >2013-12-09 07:52:33,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 50df4ff1 >2013-12-09 07:52:33,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59660ca5 >2013-12-09 07:52:34,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59660ca5 >2013-12-09 07:52:39,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1dd857f6 >2013-12-09 07:52:39,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1dd857f6 >2013-12-09 07:52:39,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2aefacf6 >2013-12-09 07:52:39,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2aefacf6 >2013-12-09 07:52:44,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 794cb8db >2013-12-09 07:52:45,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 794cb8db >2013-12-09 07:52:45,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59a3c81b >2013-12-09 07:52:45,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59a3c81b >2013-12-09 07:52:50,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69dd41ad >2013-12-09 07:52:51,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 69dd41ad >2013-12-09 07:52:51,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 496f4918 >2013-12-09 07:52:51,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 496f4918 >2013-12-09 07:52:56,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 203bba6f >2013-12-09 07:52:57,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 203bba6f >2013-12-09 07:52:57,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 471da452 >2013-12-09 07:52:57,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 471da452 >2013-12-09 07:53:02,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d1a6beb >2013-12-09 07:53:02,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d1a6beb >2013-12-09 07:53:02,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 305d6336 >2013-12-09 07:53:03,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 305d6336 >2013-12-09 07:53:08,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 764d086c >2013-12-09 07:53:08,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 764d086c >2013-12-09 07:53:08,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51106cfd >2013-12-09 07:53:08,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51106cfd >2013-12-09 07:53:10,393 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-38) No up server in cluster >2013-12-09 07:53:10,393 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-38) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:53:10,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3599e4f3 >2013-12-09 07:53:10,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3599e4f3 >2013-12-09 07:53:13,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a6b7d8d >2013-12-09 07:53:14,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1a6b7d8d >2013-12-09 07:53:14,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3250c0be >2013-12-09 07:53:14,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3250c0be >2013-12-09 07:53:19,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 919122f >2013-12-09 07:53:20,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 919122f >2013-12-09 07:53:20,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 28702b78 >2013-12-09 07:53:20,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28702b78 >2013-12-09 07:53:25,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 199c838a >2013-12-09 07:53:25,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 199c838a >2013-12-09 07:53:25,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6455d9f2 >2013-12-09 07:53:26,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6455d9f2 >2013-12-09 07:53:31,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6af5eaa2 >2013-12-09 07:53:31,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6af5eaa2 >2013-12-09 07:53:31,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bf79234 >2013-12-09 07:53:32,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bf79234 >2013-12-09 07:53:37,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50d0312e >2013-12-09 07:53:37,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 50d0312e >2013-12-09 07:53:37,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e649e05 >2013-12-09 07:53:37,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e649e05 >2013-12-09 07:53:42,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b3ccefc >2013-12-09 07:53:43,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b3ccefc >2013-12-09 07:53:43,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12b9ca0 >2013-12-09 07:53:43,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12b9ca0 >2013-12-09 07:53:48,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79726b9b >2013-12-09 07:53:49,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 79726b9b >2013-12-09 07:53:49,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ee8c858 >2013-12-09 07:53:49,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ee8c858 >2013-12-09 07:53:54,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18fc78e >2013-12-09 07:53:54,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 18fc78e >2013-12-09 07:53:54,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11cae981 >2013-12-09 07:53:55,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11cae981 >2013-12-09 07:54:00,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57a50325 >2013-12-09 07:54:00,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 57a50325 >2013-12-09 07:54:00,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 794e3d6b >2013-12-09 07:54:00,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 794e3d6b >2013-12-09 07:54:05,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78fbba3e >2013-12-09 07:54:06,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 78fbba3e >2013-12-09 07:54:06,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 656d0a63 >2013-12-09 07:54:06,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 656d0a63 >2013-12-09 07:54:10,678 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-21) No up server in cluster >2013-12-09 07:54:10,678 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-21) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:54:10,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 240b3086 >2013-12-09 07:54:10,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterTasksListVDSCommand, return: [], log id: 240b3086 >2013-12-09 07:54:11,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a60133e >2013-12-09 07:54:12,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3a60133e >2013-12-09 07:54:12,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b7ae098 >2013-12-09 07:54:12,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b7ae098 >2013-12-09 07:54:17,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 884f605 >2013-12-09 07:54:18,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 884f605 >2013-12-09 07:54:18,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ae8324e >2013-12-09 07:54:18,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ae8324e >2013-12-09 07:54:23,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a22cdee >2013-12-09 07:54:23,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4a22cdee >2013-12-09 07:54:23,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b73031f >2013-12-09 07:54:24,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b73031f >2013-12-09 07:54:29,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16c48b04 >2013-12-09 07:54:29,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 16c48b04 >2013-12-09 07:54:29,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11adbc59 >2013-12-09 07:54:29,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11adbc59 >2013-12-09 07:54:34,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4378f83d >2013-12-09 07:54:35,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4378f83d >2013-12-09 07:54:35,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64b4a0ad >2013-12-09 07:54:35,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64b4a0ad >2013-12-09 07:54:40,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5dede6df >2013-12-09 07:54:41,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5dede6df >2013-12-09 07:54:41,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b663f9b >2013-12-09 07:54:41,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b663f9b >2013-12-09 07:54:46,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f14d9ab >2013-12-09 07:54:46,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3f14d9ab >2013-12-09 07:54:46,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 372e0ec0 >2013-12-09 07:54:47,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 372e0ec0 >2013-12-09 07:54:52,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b569e6e >2013-12-09 07:54:52,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5b569e6e >2013-12-09 07:54:52,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 495ef06d >2013-12-09 07:54:53,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 495ef06d >2013-12-09 07:54:58,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33721d56 >2013-12-09 07:54:58,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 33721d56 >2013-12-09 07:54:58,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36f62e14 >2013-12-09 07:54:58,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36f62e14 >2013-12-09 07:55:03,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41371efa >2013-12-09 07:55:04,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 41371efa >2013-12-09 07:55:04,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 452d08cf >2013-12-09 07:55:04,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 452d08cf >2013-12-09 07:55:09,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c3e181f >2013-12-09 07:55:10,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: c3e181f >2013-12-09 07:55:10,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f3c9890 >2013-12-09 07:55:10,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f3c9890 >2013-12-09 07:55:10,959 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-92) No up server in cluster >2013-12-09 07:55:10,959 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-92) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:55:10,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3de0110 >2013-12-09 07:55:11,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3de0110 >2013-12-09 07:55:15,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d5dbbe6 >2013-12-09 07:55:15,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d5dbbe6 >2013-12-09 07:55:15,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6aa6e52d >2013-12-09 07:55:16,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6aa6e52d >2013-12-09 07:55:21,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e694a73 >2013-12-09 07:55:21,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7e694a73 >2013-12-09 07:55:21,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47a90ef5 >2013-12-09 07:55:21,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47a90ef5 >2013-12-09 07:55:26,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c296a7d >2013-12-09 07:55:27,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c296a7d >2013-12-09 07:55:27,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 454095d6 >2013-12-09 07:55:27,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 454095d6 >2013-12-09 07:55:32,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 938d352 >2013-12-09 07:55:33,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 938d352 >2013-12-09 07:55:33,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10940af1 >2013-12-09 07:55:33,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10940af1 >2013-12-09 07:55:38,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: bce560c >2013-12-09 07:55:38,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: bce560c >2013-12-09 07:55:38,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 316abbdd >2013-12-09 07:55:39,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 316abbdd >2013-12-09 07:55:44,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56a1b6aa >2013-12-09 07:55:44,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 56a1b6aa >2013-12-09 07:55:44,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 715ff30f >2013-12-09 07:55:45,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 715ff30f >2013-12-09 07:55:50,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a44c734 >2013-12-09 07:55:50,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a44c734 >2013-12-09 07:55:50,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 577c56fe >2013-12-09 07:55:50,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 577c56fe >2013-12-09 07:55:55,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28d594e0 >2013-12-09 07:55:56,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 28d594e0 >2013-12-09 07:55:56,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 443c2ace >2013-12-09 07:55:56,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 443c2ace >2013-12-09 07:56:01,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 234f153d >2013-12-09 07:56:02,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 234f153d >2013-12-09 07:56:02,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39b2956a >2013-12-09 07:56:02,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39b2956a >2013-12-09 07:56:07,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36127068 >2013-12-09 07:56:07,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 36127068 >2013-12-09 07:56:07,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 102ec3c5 >2013-12-09 07:56:08,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 102ec3c5 >2013-12-09 07:56:11,245 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-99) No up server in cluster >2013-12-09 07:56:11,245 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-99) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:56:11,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72e4eefc >2013-12-09 07:56:11,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterTasksListVDSCommand, return: [], log id: 72e4eefc >2013-12-09 07:56:13,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f04a588 >2013-12-09 07:56:13,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f04a588 >2013-12-09 07:56:13,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d4fe06 >2013-12-09 07:56:13,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d4fe06 >2013-12-09 07:56:18,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27170b24 >2013-12-09 07:56:19,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 27170b24 >2013-12-09 07:56:19,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21b46d06 >2013-12-09 07:56:19,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21b46d06 >2013-12-09 07:56:24,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4813799b >2013-12-09 07:56:25,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4813799b >2013-12-09 07:56:25,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 336c760d >2013-12-09 07:56:25,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 336c760d >2013-12-09 07:56:30,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3130f3c9 >2013-12-09 07:56:31,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3130f3c9 >2013-12-09 07:56:31,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59470279 >2013-12-09 07:56:31,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59470279 >2013-12-09 07:56:36,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18bcbf12 >2013-12-09 07:56:36,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 18bcbf12 >2013-12-09 07:56:36,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71982c15 >2013-12-09 07:56:37,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71982c15 >2013-12-09 07:56:42,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a40a9bc >2013-12-09 07:56:42,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: a40a9bc >2013-12-09 07:56:42,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f7834f2 >2013-12-09 07:56:42,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f7834f2 >2013-12-09 07:56:47,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 380204b9 >2013-12-09 07:56:48,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 380204b9 >2013-12-09 07:56:48,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 452efcaa >2013-12-09 07:56:48,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 452efcaa >2013-12-09 07:56:53,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55011447 >2013-12-09 07:56:54,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 55011447 >2013-12-09 07:56:54,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63942272 >2013-12-09 07:56:54,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63942272 >2013-12-09 07:56:59,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bf1c9f9 >2013-12-09 07:56:59,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1bf1c9f9 >2013-12-09 07:56:59,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b843c65 >2013-12-09 07:57:00,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b843c65 >2013-12-09 07:57:05,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e87d124 >2013-12-09 07:57:05,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e87d124 >2013-12-09 07:57:05,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c7e5dfe >2013-12-09 07:57:05,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c7e5dfe >2013-12-09 07:57:10,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e26e775 >2013-12-09 07:57:11,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7e26e775 >2013-12-09 07:57:11,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29e1c035 >2013-12-09 07:57:11,529 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-29) No up server in cluster >2013-12-09 07:57:11,529 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-29) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:57:11,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f073e3f >2013-12-09 07:57:11,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29e1c035 >2013-12-09 07:57:11,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2f073e3f >2013-12-09 07:57:16,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ae53a0e >2013-12-09 07:57:17,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6ae53a0e >2013-12-09 07:57:17,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a76b65e >2013-12-09 07:57:17,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a76b65e >2013-12-09 07:57:22,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38afd2f8 >2013-12-09 07:57:23,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 38afd2f8 >2013-12-09 07:57:23,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 602fa24b >2013-12-09 07:57:23,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 602fa24b >2013-12-09 07:57:28,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c39263 >2013-12-09 07:57:28,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: c39263 >2013-12-09 07:57:28,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 163f6079 >2013-12-09 07:57:29,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 163f6079 >2013-12-09 07:57:34,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f859384 >2013-12-09 07:57:34,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3f859384 >2013-12-09 07:57:34,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 496b0320 >2013-12-09 07:57:34,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 496b0320 >2013-12-09 07:57:39,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7171c0aa >2013-12-09 07:57:40,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7171c0aa >2013-12-09 07:57:40,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 195ed220 >2013-12-09 07:57:40,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 195ed220 >2013-12-09 07:57:45,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4753d601 >2013-12-09 07:57:46,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4753d601 >2013-12-09 07:57:46,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 377563 >2013-12-09 07:57:46,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 377563 >2013-12-09 07:57:51,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 777f5282 >2013-12-09 07:57:51,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 777f5282 >2013-12-09 07:57:51,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2722e1e4 >2013-12-09 07:57:52,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2722e1e4 >2013-12-09 07:57:57,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 269e6a42 >2013-12-09 07:57:57,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 269e6a42 >2013-12-09 07:57:57,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7bafc0e7 >2013-12-09 07:57:57,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7bafc0e7 >2013-12-09 07:58:03,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5568dda4 >2013-12-09 07:58:03,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5568dda4 >2013-12-09 07:58:03,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ce6299d >2013-12-09 07:58:03,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ce6299d >2013-12-09 07:58:08,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e6a7a58 >2013-12-09 07:58:09,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e6a7a58 >2013-12-09 07:58:09,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34be23a8 >2013-12-09 07:58:09,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34be23a8 >2013-12-09 07:58:11,781 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-40) No up server in cluster >2013-12-09 07:58:11,782 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-40) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:58:11,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a8a5d91 >2013-12-09 07:58:12,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6a8a5d91 >2013-12-09 07:58:14,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3fa58b97 >2013-12-09 07:58:15,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3fa58b97 >2013-12-09 07:58:15,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1432ce70 >2013-12-09 07:58:15,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1432ce70 >2013-12-09 07:58:20,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76307633 >2013-12-09 07:58:20,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 76307633 >2013-12-09 07:58:20,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a90d94b >2013-12-09 07:58:21,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a90d94b >2013-12-09 07:58:26,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a24a433 >2013-12-09 07:58:26,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3a24a433 >2013-12-09 07:58:26,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b9ac0e5 >2013-12-09 07:58:26,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b9ac0e5 >2013-12-09 07:58:31,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b6257f2 >2013-12-09 07:58:32,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b6257f2 >2013-12-09 07:58:32,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13894103 >2013-12-09 07:58:32,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13894103 >2013-12-09 07:58:37,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4750f3e9 >2013-12-09 07:58:38,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4750f3e9 >2013-12-09 07:58:38,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 253aa90 >2013-12-09 07:58:38,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 253aa90 >2013-12-09 07:58:43,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 676c9a45 >2013-12-09 07:58:44,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 676c9a45 >2013-12-09 07:58:44,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15f2f8cd >2013-12-09 07:58:44,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15f2f8cd >2013-12-09 07:58:49,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51aca84c >2013-12-09 07:58:49,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 51aca84c >2013-12-09 07:58:49,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45fb3a4b >2013-12-09 07:58:50,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45fb3a4b >2013-12-09 07:58:55,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 431ea350 >2013-12-09 07:58:55,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 431ea350 >2013-12-09 07:58:55,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38c0dc67 >2013-12-09 07:58:55,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38c0dc67 >2013-12-09 07:59:00,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a7e2df0 >2013-12-09 07:59:01,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4a7e2df0 >2013-12-09 07:59:01,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a52a7c3 >2013-12-09 07:59:01,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a52a7c3 >2013-12-09 07:59:06,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4fdcd03d >2013-12-09 07:59:07,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4fdcd03d >2013-12-09 07:59:07,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51bf5d1e >2013-12-09 07:59:07,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51bf5d1e >2013-12-09 07:59:12,068 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-49) No up server in cluster >2013-12-09 07:59:12,068 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-49) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 07:59:12,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a412e92 >2013-12-09 07:59:12,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4a412e92 >2013-12-09 07:59:12,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66759a79 >2013-12-09 07:59:12,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 66759a79 >2013-12-09 07:59:12,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c11fa21 >2013-12-09 07:59:13,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c11fa21 >2013-12-09 07:59:18,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 569db06d >2013-12-09 07:59:18,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 569db06d >2013-12-09 07:59:18,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f95bc2 >2013-12-09 07:59:18,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f95bc2 >2013-12-09 07:59:23,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 579be335 >2013-12-09 07:59:24,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 579be335 >2013-12-09 07:59:24,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c475ad9 >2013-12-09 07:59:24,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c475ad9 >2013-12-09 07:59:29,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a552f5 >2013-12-09 07:59:30,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a552f5 >2013-12-09 07:59:30,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5540b6d3 >2013-12-09 07:59:30,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5540b6d3 >2013-12-09 07:59:35,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8f2b19b >2013-12-09 07:59:36,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 8f2b19b >2013-12-09 07:59:36,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 586eeffd >2013-12-09 07:59:36,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 586eeffd >2013-12-09 07:59:38,735 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Attempting to update VMs/Templates Ovf. >2013-12-09 07:59:41,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76057799 >2013-12-09 07:59:41,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 76057799 >2013-12-09 07:59:41,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40d7ad2e >2013-12-09 07:59:42,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40d7ad2e >2013-12-09 07:59:44,420 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-60) Start refreshing all users data >2013-12-09 07:59:47,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f6e91e3 >2013-12-09 07:59:47,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f6e91e3 >2013-12-09 07:59:47,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 254b002b >2013-12-09 07:59:47,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 254b002b >2013-12-09 07:59:52,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51e131c3 >2013-12-09 07:59:53,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 51e131c3 >2013-12-09 07:59:53,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3348d63a >2013-12-09 07:59:53,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3348d63a >2013-12-09 07:59:58,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c7ec7fb >2013-12-09 07:59:59,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3c7ec7fb >2013-12-09 07:59:59,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: edb718e >2013-12-09 07:59:59,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: edb718e >2013-12-09 08:00:04,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7dcbfd3a >2013-12-09 08:00:04,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7dcbfd3a >2013-12-09 08:00:04,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b0ce975 >2013-12-09 08:00:05,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b0ce975 >2013-12-09 08:00:10,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 797564cb >2013-12-09 08:00:10,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 797564cb >2013-12-09 08:00:10,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e754342 >2013-12-09 08:00:10,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e754342 >2013-12-09 08:00:12,357 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-52) No up server in cluster >2013-12-09 08:00:12,357 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-52) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:00:12,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e0d54fe >2013-12-09 08:00:12,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3e0d54fe >2013-12-09 08:00:15,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a03ec62 >2013-12-09 08:00:16,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a03ec62 >2013-12-09 08:00:16,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77f89d23 >2013-12-09 08:00:16,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77f89d23 >2013-12-09 08:00:21,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55352542 >2013-12-09 08:00:22,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 55352542 >2013-12-09 08:00:22,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 491127c4 >2013-12-09 08:00:22,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 491127c4 >2013-12-09 08:00:27,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f19ae8e >2013-12-09 08:00:27,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6f19ae8e >2013-12-09 08:00:27,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e43f5a2 >2013-12-09 08:00:28,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e43f5a2 >2013-12-09 08:00:33,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 679f5b47 >2013-12-09 08:00:33,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 679f5b47 >2013-12-09 08:00:33,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b27ee0 >2013-12-09 08:00:34,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b27ee0 >2013-12-09 08:00:39,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50a1b637 >2013-12-09 08:00:39,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 50a1b637 >2013-12-09 08:00:39,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f1653d9 >2013-12-09 08:00:39,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f1653d9 >2013-12-09 08:00:44,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26cd011c >2013-12-09 08:00:45,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 26cd011c >2013-12-09 08:00:45,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3de2146b >2013-12-09 08:00:45,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3de2146b >2013-12-09 08:00:50,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16ced7e >2013-12-09 08:00:51,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 16ced7e >2013-12-09 08:00:51,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9bcf430 >2013-12-09 08:00:51,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9bcf430 >2013-12-09 08:00:56,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ba0de3 >2013-12-09 08:00:56,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3ba0de3 >2013-12-09 08:00:56,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1069a4e1 >2013-12-09 08:00:57,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1069a4e1 >2013-12-09 08:01:02,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c14dc15 >2013-12-09 08:01:02,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5c14dc15 >2013-12-09 08:01:02,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c3be8bf >2013-12-09 08:01:02,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c3be8bf >2013-12-09 08:01:07,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a94d123 >2013-12-09 08:01:08,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2a94d123 >2013-12-09 08:01:08,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b3008a0 >2013-12-09 08:01:08,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b3008a0 >2013-12-09 08:01:12,647 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-70) No up server in cluster >2013-12-09 08:01:12,647 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-70) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:01:12,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 363a68b2 >2013-12-09 08:01:12,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterTasksListVDSCommand, return: [], log id: 363a68b2 >2013-12-09 08:01:13,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 215796e7 >2013-12-09 08:01:14,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 215796e7 >2013-12-09 08:01:14,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11da271e >2013-12-09 08:01:14,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11da271e >2013-12-09 08:01:19,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 434a9bdd >2013-12-09 08:01:20,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 434a9bdd >2013-12-09 08:01:20,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b59ec3b >2013-12-09 08:01:20,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b59ec3b >2013-12-09 08:01:25,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c7411ed >2013-12-09 08:01:25,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c7411ed >2013-12-09 08:01:25,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41a8f615 >2013-12-09 08:01:26,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41a8f615 >2013-12-09 08:01:31,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48225fe0 >2013-12-09 08:01:31,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 48225fe0 >2013-12-09 08:01:31,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ddb1953 >2013-12-09 08:01:31,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ddb1953 >2013-12-09 08:01:36,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a24d0b0 >2013-12-09 08:01:37,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6a24d0b0 >2013-12-09 08:01:37,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39318b10 >2013-12-09 08:01:37,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39318b10 >2013-12-09 08:01:42,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63edf7b3 >2013-12-09 08:01:43,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 63edf7b3 >2013-12-09 08:01:43,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e9ec665 >2013-12-09 08:01:43,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e9ec665 >2013-12-09 08:01:48,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d64d0e0 >2013-12-09 08:01:48,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d64d0e0 >2013-12-09 08:01:48,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54843842 >2013-12-09 08:01:49,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54843842 >2013-12-09 08:01:54,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79d3d61f >2013-12-09 08:01:54,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 79d3d61f >2013-12-09 08:01:54,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1bec3aaa >2013-12-09 08:01:54,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1bec3aaa >2013-12-09 08:01:59,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17fcf1f5 >2013-12-09 08:02:00,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 17fcf1f5 >2013-12-09 08:02:00,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12c67638 >2013-12-09 08:02:00,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12c67638 >2013-12-09 08:02:05,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e2f3da0 >2013-12-09 08:02:06,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7e2f3da0 >2013-12-09 08:02:06,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c91c2d0 >2013-12-09 08:02:06,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c91c2d0 >2013-12-09 08:02:11,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2532bd58 >2013-12-09 08:02:12,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2532bd58 >2013-12-09 08:02:12,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a6699af >2013-12-09 08:02:12,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a6699af >2013-12-09 08:02:12,924 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-44) No up server in cluster >2013-12-09 08:02:12,925 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-44) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:02:12,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 328c17b0 >2013-12-09 08:02:13,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterTasksListVDSCommand, return: [], log id: 328c17b0 >2013-12-09 08:02:17,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41c8848 >2013-12-09 08:02:17,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 41c8848 >2013-12-09 08:02:17,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78ade90c >2013-12-09 08:02:18,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78ade90c >2013-12-09 08:02:23,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67c4a3c8 >2013-12-09 08:02:23,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 67c4a3c8 >2013-12-09 08:02:23,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38efecea >2013-12-09 08:02:23,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38efecea >2013-12-09 08:02:28,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 351b68a >2013-12-09 08:02:29,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 351b68a >2013-12-09 08:02:29,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ff04804 >2013-12-09 08:02:29,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ff04804 >2013-12-09 08:02:34,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6bd1681d >2013-12-09 08:02:35,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6bd1681d >2013-12-09 08:02:35,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45f79b71 >2013-12-09 08:02:35,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45f79b71 >2013-12-09 08:02:40,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: dd37481 >2013-12-09 08:02:41,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: dd37481 >2013-12-09 08:02:41,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1cfc5c81 >2013-12-09 08:02:41,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1cfc5c81 >2013-12-09 08:02:46,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d6e267b >2013-12-09 08:02:46,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d6e267b >2013-12-09 08:02:46,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ff29df7 >2013-12-09 08:02:47,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ff29df7 >2013-12-09 08:02:52,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d13e135 >2013-12-09 08:02:52,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d13e135 >2013-12-09 08:02:52,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12a14ec3 >2013-12-09 08:02:52,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12a14ec3 >2013-12-09 08:02:57,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47f5285d >2013-12-09 08:02:58,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 47f5285d >2013-12-09 08:02:58,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e7cf4d5 >2013-12-09 08:02:58,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e7cf4d5 >2013-12-09 08:03:03,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f600c6f >2013-12-09 08:03:04,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f600c6f >2013-12-09 08:03:04,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1dfee5a0 >2013-12-09 08:03:04,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1dfee5a0 >2013-12-09 08:03:09,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b281f6d >2013-12-09 08:03:09,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b281f6d >2013-12-09 08:03:09,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13ea778d >2013-12-09 08:03:10,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13ea778d >2013-12-09 08:03:13,207 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-11) No up server in cluster >2013-12-09 08:03:13,207 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-11) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:03:13,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1cb3f940 >2013-12-09 08:03:13,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1cb3f940 >2013-12-09 08:03:15,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5887b085 >2013-12-09 08:03:15,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5887b085 >2013-12-09 08:03:15,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a85c2f0 >2013-12-09 08:03:15,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a85c2f0 >2013-12-09 08:03:20,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1eadab32 >2013-12-09 08:03:21,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1eadab32 >2013-12-09 08:03:21,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7bab43bd >2013-12-09 08:03:21,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7bab43bd >2013-12-09 08:03:26,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b05a59f >2013-12-09 08:03:27,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b05a59f >2013-12-09 08:03:27,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39a1472c >2013-12-09 08:03:27,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39a1472c >2013-12-09 08:03:32,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75ed246b >2013-12-09 08:03:32,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 75ed246b >2013-12-09 08:03:32,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2cab33d8 >2013-12-09 08:03:33,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2cab33d8 >2013-12-09 08:03:38,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32314161 >2013-12-09 08:03:38,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 32314161 >2013-12-09 08:03:38,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e449c1 >2013-12-09 08:03:39,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e449c1 >2013-12-09 08:03:44,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bf22ae7 >2013-12-09 08:03:44,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1bf22ae7 >2013-12-09 08:03:44,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 279d7695 >2013-12-09 08:03:44,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 279d7695 >2013-12-09 08:03:49,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ebf7841 >2013-12-09 08:03:50,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2ebf7841 >2013-12-09 08:03:50,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79ce183d >2013-12-09 08:03:50,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79ce183d >2013-12-09 08:03:55,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1dffc04d >2013-12-09 08:03:56,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1dffc04d >2013-12-09 08:03:56,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d4c40a1 >2013-12-09 08:03:56,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d4c40a1 >2013-12-09 08:04:01,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52d6767c >2013-12-09 08:04:01,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 52d6767c >2013-12-09 08:04:01,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d391b04 >2013-12-09 08:04:02,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d391b04 >2013-12-09 08:04:07,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31805c02 >2013-12-09 08:04:07,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 31805c02 >2013-12-09 08:04:07,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e1f574f >2013-12-09 08:04:07,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e1f574f >2013-12-09 08:04:12,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f58469 >2013-12-09 08:04:13,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3f58469 >2013-12-09 08:04:13,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ac94731 >2013-12-09 08:04:13,497 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-53) No up server in cluster >2013-12-09 08:04:13,497 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-53) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:04:13,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 576f2c31 >2013-12-09 08:04:13,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ac94731 >2013-12-09 08:04:13,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterTasksListVDSCommand, return: [], log id: 576f2c31 >2013-12-09 08:04:18,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 421bfba6 >2013-12-09 08:04:19,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 421bfba6 >2013-12-09 08:04:19,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 707c02f5 >2013-12-09 08:04:19,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 707c02f5 >2013-12-09 08:04:24,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18db290e >2013-12-09 08:04:24,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 18db290e >2013-12-09 08:04:24,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4cc32b03 >2013-12-09 08:04:25,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4cc32b03 >2013-12-09 08:04:30,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 293169c8 >2013-12-09 08:04:30,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 293169c8 >2013-12-09 08:04:30,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c24aa32 >2013-12-09 08:04:31,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c24aa32 >2013-12-09 08:04:36,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d58ff6e >2013-12-09 08:04:36,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2d58ff6e >2013-12-09 08:04:36,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 769d651b >2013-12-09 08:04:36,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 769d651b >2013-12-09 08:04:41,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6afcaeca >2013-12-09 08:04:42,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6afcaeca >2013-12-09 08:04:42,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f516a1c >2013-12-09 08:04:42,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f516a1c >2013-12-09 08:04:47,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1714ed10 >2013-12-09 08:04:48,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1714ed10 >2013-12-09 08:04:48,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a1ae19d >2013-12-09 08:04:48,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a1ae19d >2013-12-09 08:04:53,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f8a71de >2013-12-09 08:04:53,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5f8a71de >2013-12-09 08:04:53,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63f0da3a >2013-12-09 08:04:54,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63f0da3a >2013-12-09 08:04:59,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 438902f2 >2013-12-09 08:04:59,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 438902f2 >2013-12-09 08:04:59,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d7ae46e >2013-12-09 08:04:59,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d7ae46e >2013-12-09 08:05:04,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8790e94 >2013-12-09 08:05:05,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 8790e94 >2013-12-09 08:05:05,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b5f1975 >2013-12-09 08:05:05,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b5f1975 >2013-12-09 08:05:10,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b3222c5 >2013-12-09 08:05:11,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b3222c5 >2013-12-09 08:05:11,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 14764400 >2013-12-09 08:05:11,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14764400 >2013-12-09 08:05:13,769 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-67) No up server in cluster >2013-12-09 08:05:13,769 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-67) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:05:13,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 196c8715 >2013-12-09 08:05:14,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterTasksListVDSCommand, return: [], log id: 196c8715 >2013-12-09 08:05:16,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a8e15 >2013-12-09 08:05:17,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: a8e15 >2013-12-09 08:05:17,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56342a3f >2013-12-09 08:05:17,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56342a3f >2013-12-09 08:05:22,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d0eef77 >2013-12-09 08:05:22,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d0eef77 >2013-12-09 08:05:22,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4da10188 >2013-12-09 08:05:23,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4da10188 >2013-12-09 08:05:28,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 162ba37c >2013-12-09 08:05:28,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 162ba37c >2013-12-09 08:05:28,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fd4621d >2013-12-09 08:05:28,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fd4621d >2013-12-09 08:05:33,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 382ba49d >2013-12-09 08:05:34,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 382ba49d >2013-12-09 08:05:34,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37c78411 >2013-12-09 08:05:34,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37c78411 >2013-12-09 08:05:39,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71f5a22 >2013-12-09 08:05:40,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 71f5a22 >2013-12-09 08:05:40,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3446ea6e >2013-12-09 08:05:40,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3446ea6e >2013-12-09 08:05:45,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2db7a2c1 >2013-12-09 08:05:45,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2db7a2c1 >2013-12-09 08:05:45,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4426462e >2013-12-09 08:05:46,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4426462e >2013-12-09 08:05:51,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f706624 >2013-12-09 08:05:51,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: f706624 >2013-12-09 08:05:51,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1fe59051 >2013-12-09 08:05:51,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1fe59051 >2013-12-09 08:05:57,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17648679 >2013-12-09 08:05:57,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 17648679 >2013-12-09 08:05:57,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ce8ec11 >2013-12-09 08:05:57,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ce8ec11 >2013-12-09 08:06:02,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77cf8934 >2013-12-09 08:06:03,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 77cf8934 >2013-12-09 08:06:03,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6097ac35 >2013-12-09 08:06:03,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6097ac35 >2013-12-09 08:06:08,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 261f1fa4 >2013-12-09 08:06:09,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 261f1fa4 >2013-12-09 08:06:09,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 188cdce7 >2013-12-09 08:06:09,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 188cdce7 >2013-12-09 08:06:14,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c15c8ee >2013-12-09 08:06:14,356 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) No up server in cluster >2013-12-09 08:06:14,356 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:06:14,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 388b7221 >2013-12-09 08:06:14,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterTasksListVDSCommand, return: [], log id: 388b7221 >2013-12-09 08:06:14,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c15c8ee >2013-12-09 08:06:14,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 83ca118 >2013-12-09 08:06:15,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 83ca118 >2013-12-09 08:06:20,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e50bd3d >2013-12-09 08:06:20,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: e50bd3d >2013-12-09 08:06:20,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34b34735 >2013-12-09 08:06:20,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34b34735 >2013-12-09 08:06:25,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32b911a3 >2013-12-09 08:06:26,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 32b911a3 >2013-12-09 08:06:26,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66c5e73f >2013-12-09 08:06:26,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66c5e73f >2013-12-09 08:06:31,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d23a34e >2013-12-09 08:06:32,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: d23a34e >2013-12-09 08:06:32,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e854e62 >2013-12-09 08:06:32,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e854e62 >2013-12-09 08:06:37,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3234d3e2 >2013-12-09 08:06:37,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3234d3e2 >2013-12-09 08:06:37,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 629c04b7 >2013-12-09 08:06:38,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 629c04b7 >2013-12-09 08:06:43,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 160f6607 >2013-12-09 08:06:43,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 160f6607 >2013-12-09 08:06:43,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e7814b4 >2013-12-09 08:06:43,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e7814b4 >2013-12-09 08:06:48,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21f183ef >2013-12-09 08:06:49,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 21f183ef >2013-12-09 08:06:49,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 398a7220 >2013-12-09 08:06:49,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 398a7220 >2013-12-09 08:06:54,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79fac233 >2013-12-09 08:06:55,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 79fac233 >2013-12-09 08:06:55,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b24a345 >2013-12-09 08:06:55,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b24a345 >2013-12-09 08:07:00,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 485ebc08 >2013-12-09 08:07:01,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 485ebc08 >2013-12-09 08:07:01,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30337d07 >2013-12-09 08:07:01,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30337d07 >2013-12-09 08:07:06,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59c65b01 >2013-12-09 08:07:06,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 59c65b01 >2013-12-09 08:07:06,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72ef1cf8 >2013-12-09 08:07:07,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72ef1cf8 >2013-12-09 08:07:12,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47eea04d >2013-12-09 08:07:12,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 47eea04d >2013-12-09 08:07:12,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f191f3b >2013-12-09 08:07:12,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f191f3b >2013-12-09 08:07:14,619 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-72) No up server in cluster >2013-12-09 08:07:14,619 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-72) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:07:14,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54695095 >2013-12-09 08:07:14,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterTasksListVDSCommand, return: [], log id: 54695095 >2013-12-09 08:07:17,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b2db9ab >2013-12-09 08:07:18,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b2db9ab >2013-12-09 08:07:18,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33335825 >2013-12-09 08:07:18,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33335825 >2013-12-09 08:07:23,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a3607c3 >2013-12-09 08:07:24,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4a3607c3 >2013-12-09 08:07:24,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: da8b497 >2013-12-09 08:07:24,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: da8b497 >2013-12-09 08:07:29,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24af91f7 >2013-12-09 08:07:29,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 24af91f7 >2013-12-09 08:07:29,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c9cff2d >2013-12-09 08:07:30,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c9cff2d >2013-12-09 08:07:35,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 92c6f7 >2013-12-09 08:07:35,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 92c6f7 >2013-12-09 08:07:35,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f06e558 >2013-12-09 08:07:35,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f06e558 >2013-12-09 08:07:40,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ed13d83 >2013-12-09 08:07:41,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7ed13d83 >2013-12-09 08:07:41,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10b956fc >2013-12-09 08:07:41,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10b956fc >2013-12-09 08:07:46,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41af1011 >2013-12-09 08:07:47,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 41af1011 >2013-12-09 08:07:47,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 494c6a75 >2013-12-09 08:07:47,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 494c6a75 >2013-12-09 08:07:52,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5216525e >2013-12-09 08:07:53,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5216525e >2013-12-09 08:07:53,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4cf22e35 >2013-12-09 08:07:53,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4cf22e35 >2013-12-09 08:07:58,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39d3a292 >2013-12-09 08:07:58,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 39d3a292 >2013-12-09 08:07:58,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34427a9e >2013-12-09 08:07:59,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34427a9e >2013-12-09 08:08:04,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 788e4416 >2013-12-09 08:08:04,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 788e4416 >2013-12-09 08:08:04,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44a1903f >2013-12-09 08:08:04,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44a1903f >2013-12-09 08:08:09,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3499a75c >2013-12-09 08:08:10,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3499a75c >2013-12-09 08:08:10,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35c798f2 >2013-12-09 08:08:10,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35c798f2 >2013-12-09 08:08:14,898 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) No up server in cluster >2013-12-09 08:08:14,899 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:08:14,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74895422 >2013-12-09 08:08:15,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterTasksListVDSCommand, return: [], log id: 74895422 >2013-12-09 08:08:15,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3eb38f3f >2013-12-09 08:08:16,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3eb38f3f >2013-12-09 08:08:16,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57f9c195 >2013-12-09 08:08:16,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57f9c195 >2013-12-09 08:08:21,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 287a323 >2013-12-09 08:08:21,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 287a323 >2013-12-09 08:08:21,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47c80af2 >2013-12-09 08:08:22,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47c80af2 >2013-12-09 08:08:27,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a60a8aa >2013-12-09 08:08:27,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4a60a8aa >2013-12-09 08:08:27,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1dbc0028 >2013-12-09 08:08:28,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1dbc0028 >2013-12-09 08:08:33,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a580836 >2013-12-09 08:08:33,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: a580836 >2013-12-09 08:08:33,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38eeb5ca >2013-12-09 08:08:33,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38eeb5ca >2013-12-09 08:08:38,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62bfd956 >2013-12-09 08:08:39,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 62bfd956 >2013-12-09 08:08:39,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 447e9c0c >2013-12-09 08:08:39,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 447e9c0c >2013-12-09 08:08:44,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 431fbb0 >2013-12-09 08:08:45,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 431fbb0 >2013-12-09 08:08:45,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ba34c1c >2013-12-09 08:08:45,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ba34c1c >2013-12-09 08:08:50,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: aacdc92 >2013-12-09 08:08:50,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: aacdc92 >2013-12-09 08:08:50,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ef302d0 >2013-12-09 08:08:51,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ef302d0 >2013-12-09 08:08:56,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7bf1b921 >2013-12-09 08:08:56,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7bf1b921 >2013-12-09 08:08:56,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7296bee9 >2013-12-09 08:08:56,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7296bee9 >2013-12-09 08:09:01,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26509ecb >2013-12-09 08:09:02,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 26509ecb >2013-12-09 08:09:02,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51ca2aa2 >2013-12-09 08:09:02,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51ca2aa2 >2013-12-09 08:09:07,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b4ca57d >2013-12-09 08:09:08,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b4ca57d >2013-12-09 08:09:08,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e19792f >2013-12-09 08:09:08,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e19792f >2013-12-09 08:09:13,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a68804d >2013-12-09 08:09:14,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a68804d >2013-12-09 08:09:14,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4430962c >2013-12-09 08:09:14,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4430962c >2013-12-09 08:09:15,176 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) No up server in cluster >2013-12-09 08:09:15,176 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:09:15,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4317dc12 >2013-12-09 08:09:15,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4317dc12 >2013-12-09 08:09:19,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18f36039 >2013-12-09 08:09:19,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 18f36039 >2013-12-09 08:09:19,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7de95b22 >2013-12-09 08:09:20,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7de95b22 >2013-12-09 08:09:25,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 15018ce3 >2013-12-09 08:09:25,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 15018ce3 >2013-12-09 08:09:25,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ccb7a04 >2013-12-09 08:09:25,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ccb7a04 >2013-12-09 08:09:30,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c714889 >2013-12-09 08:09:31,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c714889 >2013-12-09 08:09:31,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 718471e1 >2013-12-09 08:09:31,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 718471e1 >2013-12-09 08:09:36,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79ce0ce4 >2013-12-09 08:09:37,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 79ce0ce4 >2013-12-09 08:09:37,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b1714a9 >2013-12-09 08:09:37,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b1714a9 >2013-12-09 08:09:42,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 136fb21d >2013-12-09 08:09:43,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 136fb21d >2013-12-09 08:09:43,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f1fc613 >2013-12-09 08:09:43,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f1fc613 >2013-12-09 08:09:48,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3bd71b53 >2013-12-09 08:09:48,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3bd71b53 >2013-12-09 08:09:48,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 566f6cfa >2013-12-09 08:09:49,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 566f6cfa >2013-12-09 08:09:54,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3395091c >2013-12-09 08:09:54,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3395091c >2013-12-09 08:09:54,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 621ed493 >2013-12-09 08:09:54,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 621ed493 >2013-12-09 08:09:59,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4af6b3fe >2013-12-09 08:10:00,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4af6b3fe >2013-12-09 08:10:00,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f32cf25 >2013-12-09 08:10:00,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f32cf25 >2013-12-09 08:10:05,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 25112c6a >2013-12-09 08:10:06,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 25112c6a >2013-12-09 08:10:06,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47697a6c >2013-12-09 08:10:06,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47697a6c >2013-12-09 08:10:11,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f3e711b >2013-12-09 08:10:11,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: f3e711b >2013-12-09 08:10:11,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 201806ca >2013-12-09 08:10:12,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 201806ca >2013-12-09 08:10:15,464 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-35) No up server in cluster >2013-12-09 08:10:15,464 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-35) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:10:15,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48cb16a1 >2013-12-09 08:10:15,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterTasksListVDSCommand, return: [], log id: 48cb16a1 >2013-12-09 08:10:17,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2aa66332 >2013-12-09 08:10:17,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2aa66332 >2013-12-09 08:10:17,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a455523 >2013-12-09 08:10:17,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a455523 >2013-12-09 08:10:22,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20f5e17d >2013-12-09 08:10:23,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 20f5e17d >2013-12-09 08:10:23,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5bdf6375 >2013-12-09 08:10:23,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5bdf6375 >2013-12-09 08:10:28,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 373c048f >2013-12-09 08:10:29,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 373c048f >2013-12-09 08:10:29,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ea4d04 >2013-12-09 08:10:29,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ea4d04 >2013-12-09 08:10:34,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4cb21e05 >2013-12-09 08:10:34,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4cb21e05 >2013-12-09 08:10:34,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4bcf2546 >2013-12-09 08:10:35,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4bcf2546 >2013-12-09 08:10:40,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b894414 >2013-12-09 08:10:40,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b894414 >2013-12-09 08:10:40,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6fe6b01a >2013-12-09 08:10:41,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6fe6b01a >2013-12-09 08:10:46,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9ef3def >2013-12-09 08:10:46,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 9ef3def >2013-12-09 08:10:46,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9528354 >2013-12-09 08:10:46,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9528354 >2013-12-09 08:10:51,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ea65e6 >2013-12-09 08:10:52,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ea65e6 >2013-12-09 08:10:52,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75e70577 >2013-12-09 08:10:52,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75e70577 >2013-12-09 08:10:57,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e4e79ff >2013-12-09 08:10:58,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2e4e79ff >2013-12-09 08:10:58,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 326f939 >2013-12-09 08:10:58,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 326f939 >2013-12-09 08:11:03,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59b4800a >2013-12-09 08:11:03,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 59b4800a >2013-12-09 08:11:03,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31e36da5 >2013-12-09 08:11:04,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31e36da5 >2013-12-09 08:11:09,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2fd7a18a >2013-12-09 08:11:09,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2fd7a18a >2013-12-09 08:11:09,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11818493 >2013-12-09 08:11:09,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11818493 >2013-12-09 08:11:14,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 330466b8 >2013-12-09 08:11:15,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 330466b8 >2013-12-09 08:11:15,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f7d3c31 >2013-12-09 08:11:15,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f7d3c31 >2013-12-09 08:11:15,738 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-82) No up server in cluster >2013-12-09 08:11:15,738 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-82) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:11:15,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 14f584d1 >2013-12-09 08:11:16,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterTasksListVDSCommand, return: [], log id: 14f584d1 >2013-12-09 08:11:20,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6591a663 >2013-12-09 08:11:21,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6591a663 >2013-12-09 08:11:21,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42759f4 >2013-12-09 08:11:21,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42759f4 >2013-12-09 08:11:26,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2555a83f >2013-12-09 08:11:27,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2555a83f >2013-12-09 08:11:27,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3df3f9fe >2013-12-09 08:11:27,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3df3f9fe >2013-12-09 08:11:32,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40476ab7 >2013-12-09 08:11:32,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 40476ab7 >2013-12-09 08:11:32,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10be3116 >2013-12-09 08:11:33,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10be3116 >2013-12-09 08:11:38,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 147b73b6 >2013-12-09 08:11:38,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 147b73b6 >2013-12-09 08:11:38,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2df05e10 >2013-12-09 08:11:38,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2df05e10 >2013-12-09 08:11:43,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e8bdaa6 >2013-12-09 08:11:44,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e8bdaa6 >2013-12-09 08:11:44,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3860856b >2013-12-09 08:11:44,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3860856b >2013-12-09 08:11:49,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 512f613a >2013-12-09 08:11:50,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 512f613a >2013-12-09 08:11:50,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33cf3a45 >2013-12-09 08:11:50,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33cf3a45 >2013-12-09 08:11:55,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7373901c >2013-12-09 08:11:55,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7373901c >2013-12-09 08:11:55,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49dc2858 >2013-12-09 08:11:56,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49dc2858 >2013-12-09 08:12:01,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f30b434 >2013-12-09 08:12:01,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f30b434 >2013-12-09 08:12:01,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6168d9e4 >2013-12-09 08:12:01,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6168d9e4 >2013-12-09 08:12:07,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1bf481bb >2013-12-09 08:12:07,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1bf481bb >2013-12-09 08:12:07,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fd16b69 >2013-12-09 08:12:07,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fd16b69 >2013-12-09 08:12:12,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70043c9c >2013-12-09 08:12:13,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 70043c9c >2013-12-09 08:12:13,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2dc2477 >2013-12-09 08:12:13,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2dc2477 >2013-12-09 08:12:16,029 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-42) No up server in cluster >2013-12-09 08:12:16,029 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-42) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:12:16,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7cb2cc49 >2013-12-09 08:12:16,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7cb2cc49 >2013-12-09 08:12:18,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f06b3c0 >2013-12-09 08:12:19,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5f06b3c0 >2013-12-09 08:12:19,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6fa50fa4 >2013-12-09 08:12:19,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6fa50fa4 >2013-12-09 08:12:24,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26705ad2 >2013-12-09 08:12:24,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 26705ad2 >2013-12-09 08:12:24,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41ac4ed8 >2013-12-09 08:12:25,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41ac4ed8 >2013-12-09 08:12:30,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3450e3b6 >2013-12-09 08:12:30,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3450e3b6 >2013-12-09 08:12:30,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53df47f7 >2013-12-09 08:12:30,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53df47f7 >2013-12-09 08:12:35,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4644e75e >2013-12-09 08:12:36,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4644e75e >2013-12-09 08:12:36,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4da14e88 >2013-12-09 08:12:36,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4da14e88 >2013-12-09 08:12:41,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ddfca77 >2013-12-09 08:12:42,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7ddfca77 >2013-12-09 08:12:42,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43f6cb15 >2013-12-09 08:12:42,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43f6cb15 >2013-12-09 08:12:47,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: cd11946 >2013-12-09 08:12:48,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: cd11946 >2013-12-09 08:12:48,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 661c83e3 >2013-12-09 08:12:48,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 661c83e3 >2013-12-09 08:12:53,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 102941d2 >2013-12-09 08:12:53,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 102941d2 >2013-12-09 08:12:53,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27e8adab >2013-12-09 08:12:54,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27e8adab >2013-12-09 08:12:59,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46df3427 >2013-12-09 08:12:59,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 46df3427 >2013-12-09 08:12:59,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a2d9e94 >2013-12-09 08:12:59,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a2d9e94 >2013-12-09 08:13:04,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54a082fb >2013-12-09 08:13:05,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 54a082fb >2013-12-09 08:13:05,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b38fbc4 >2013-12-09 08:13:05,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b38fbc4 >2013-12-09 08:13:10,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6aaa3be >2013-12-09 08:13:11,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6aaa3be >2013-12-09 08:13:11,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69d5673b >2013-12-09 08:13:11,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69d5673b >2013-12-09 08:13:16,322 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-14) No up server in cluster >2013-12-09 08:13:16,322 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-14) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:13:16,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 390a98dd >2013-12-09 08:13:16,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c00f779 >2013-12-09 08:13:16,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterTasksListVDSCommand, return: [], log id: 390a98dd >2013-12-09 08:13:16,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c00f779 >2013-12-09 08:13:16,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4773a430 >2013-12-09 08:13:17,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4773a430 >2013-12-09 08:13:22,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17d2b08a >2013-12-09 08:13:22,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 17d2b08a >2013-12-09 08:13:22,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64bd7aa1 >2013-12-09 08:13:22,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64bd7aa1 >2013-12-09 08:13:27,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70a71c5b >2013-12-09 08:13:28,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 70a71c5b >2013-12-09 08:13:28,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f4ca9a1 >2013-12-09 08:13:28,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f4ca9a1 >2013-12-09 08:13:33,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e094149 >2013-12-09 08:13:34,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e094149 >2013-12-09 08:13:34,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54329243 >2013-12-09 08:13:34,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54329243 >2013-12-09 08:13:39,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46b01a4 >2013-12-09 08:13:40,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 46b01a4 >2013-12-09 08:13:40,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 107ac8e >2013-12-09 08:13:40,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 107ac8e >2013-12-09 08:13:45,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3980faed >2013-12-09 08:13:45,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3980faed >2013-12-09 08:13:45,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b7c6bf7 >2013-12-09 08:13:46,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b7c6bf7 >2013-12-09 08:13:51,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19c10777 >2013-12-09 08:13:51,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19c10777 >2013-12-09 08:13:51,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39b8073d >2013-12-09 08:13:51,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39b8073d >2013-12-09 08:13:56,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64f589ba >2013-12-09 08:13:57,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 64f589ba >2013-12-09 08:13:57,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4386f8fa >2013-12-09 08:13:57,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4386f8fa >2013-12-09 08:14:02,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 204cd9dd >2013-12-09 08:14:03,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 204cd9dd >2013-12-09 08:14:03,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5549d191 >2013-12-09 08:14:03,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5549d191 >2013-12-09 08:14:08,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8aa9834 >2013-12-09 08:14:08,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 8aa9834 >2013-12-09 08:14:08,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 161677af >2013-12-09 08:14:09,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 161677af >2013-12-09 08:14:14,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ef69b7a >2013-12-09 08:14:14,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4ef69b7a >2013-12-09 08:14:14,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34911edc >2013-12-09 08:14:15,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34911edc >2013-12-09 08:14:16,589 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-96) No up server in cluster >2013-12-09 08:14:16,589 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-96) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:14:16,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 705e4de3 >2013-12-09 08:14:16,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterTasksListVDSCommand, return: [], log id: 705e4de3 >2013-12-09 08:14:20,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5bd865e3 >2013-12-09 08:14:20,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5bd865e3 >2013-12-09 08:14:20,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21f31059 >2013-12-09 08:14:20,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21f31059 >2013-12-09 08:14:25,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e832377 >2013-12-09 08:14:26,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e832377 >2013-12-09 08:14:26,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c9e0c6c >2013-12-09 08:14:26,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c9e0c6c >2013-12-09 08:14:31,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6068a272 >2013-12-09 08:14:32,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6068a272 >2013-12-09 08:14:32,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b27749e >2013-12-09 08:14:32,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b27749e >2013-12-09 08:14:37,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57afbff9 >2013-12-09 08:14:37,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 57afbff9 >2013-12-09 08:14:37,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 301edf95 >2013-12-09 08:14:38,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 301edf95 >2013-12-09 08:14:43,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 661e4316 >2013-12-09 08:14:43,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 661e4316 >2013-12-09 08:14:43,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 444e459c >2013-12-09 08:14:43,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 444e459c >2013-12-09 08:14:48,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b2cc68f >2013-12-09 08:14:49,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5b2cc68f >2013-12-09 08:14:49,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 562d75fc >2013-12-09 08:14:49,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 562d75fc >2013-12-09 08:14:54,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3221500d >2013-12-09 08:14:55,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3221500d >2013-12-09 08:14:55,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ee7c27b >2013-12-09 08:14:55,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ee7c27b >2013-12-09 08:15:00,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5bf300b3 >2013-12-09 08:15:01,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5bf300b3 >2013-12-09 08:15:01,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71b7beed >2013-12-09 08:15:01,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71b7beed >2013-12-09 08:15:06,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7213533c >2013-12-09 08:15:06,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7213533c >2013-12-09 08:15:06,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e2d1d06 >2013-12-09 08:15:07,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e2d1d06 >2013-12-09 08:15:12,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b62cd3f >2013-12-09 08:15:12,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b62cd3f >2013-12-09 08:15:12,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64caab59 >2013-12-09 08:15:12,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64caab59 >2013-12-09 08:15:16,878 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-40) No up server in cluster >2013-12-09 08:15:16,878 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-40) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:15:16,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c48276d >2013-12-09 08:15:17,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3c48276d >2013-12-09 08:15:17,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5fa29f9c >2013-12-09 08:15:18,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5fa29f9c >2013-12-09 08:15:18,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6bbc2de2 >2013-12-09 08:15:18,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6bbc2de2 >2013-12-09 08:15:23,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2daecd0c >2013-12-09 08:15:24,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2daecd0c >2013-12-09 08:15:24,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 132ae8bd >2013-12-09 08:15:24,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 132ae8bd >2013-12-09 08:15:29,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 165eac72 >2013-12-09 08:15:29,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 165eac72 >2013-12-09 08:15:29,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 411c54a9 >2013-12-09 08:15:30,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 411c54a9 >2013-12-09 08:15:35,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 276e624f >2013-12-09 08:15:35,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 276e624f >2013-12-09 08:15:35,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e33f3e9 >2013-12-09 08:15:35,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e33f3e9 >2013-12-09 08:15:41,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a79085b >2013-12-09 08:15:41,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a79085b >2013-12-09 08:15:41,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f03fbbb >2013-12-09 08:15:41,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f03fbbb >2013-12-09 08:15:46,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37d2e9b2 >2013-12-09 08:15:47,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 37d2e9b2 >2013-12-09 08:15:47,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ead817f >2013-12-09 08:15:47,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ead817f >2013-12-09 08:15:52,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4401865f >2013-12-09 08:15:53,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4401865f >2013-12-09 08:15:53,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 439064a8 >2013-12-09 08:15:53,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 439064a8 >2013-12-09 08:15:58,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 827f058 >2013-12-09 08:15:58,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 827f058 >2013-12-09 08:15:58,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5692c2be >2013-12-09 08:15:59,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5692c2be >2013-12-09 08:16:04,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4592841d >2013-12-09 08:16:04,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4592841d >2013-12-09 08:16:04,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15bd8d9c >2013-12-09 08:16:04,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15bd8d9c >2013-12-09 08:16:09,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 473fef30 >2013-12-09 08:16:10,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 473fef30 >2013-12-09 08:16:10,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d090e6e >2013-12-09 08:16:10,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d090e6e >2013-12-09 08:16:15,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 116acc4b >2013-12-09 08:16:16,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 116acc4b >2013-12-09 08:16:16,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35a439e8 >2013-12-09 08:16:16,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35a439e8 >2013-12-09 08:16:17,318 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-22) No up server in cluster >2013-12-09 08:16:17,318 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-22) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:16:17,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f13311 >2013-12-09 08:16:17,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterTasksListVDSCommand, return: [], log id: f13311 >2013-12-09 08:16:21,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5437f2f9 >2013-12-09 08:16:21,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5437f2f9 >2013-12-09 08:16:21,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69dbe74c >2013-12-09 08:16:22,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69dbe74c >2013-12-09 08:16:27,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a9a21ce >2013-12-09 08:16:27,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6a9a21ce >2013-12-09 08:16:27,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1851879a >2013-12-09 08:16:28,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1851879a >2013-12-09 08:16:33,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 208ebbed >2013-12-09 08:16:33,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 208ebbed >2013-12-09 08:16:33,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3320a4f8 >2013-12-09 08:16:33,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3320a4f8 >2013-12-09 08:16:38,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e7547bb >2013-12-09 08:16:39,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e7547bb >2013-12-09 08:16:39,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 567011e9 >2013-12-09 08:16:39,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 567011e9 >2013-12-09 08:16:44,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7185aa3a >2013-12-09 08:16:45,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7185aa3a >2013-12-09 08:16:45,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2920d6c7 >2013-12-09 08:16:45,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2920d6c7 >2013-12-09 08:16:50,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25e52f9a >2013-12-09 08:16:50,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 25e52f9a >2013-12-09 08:16:50,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f882093 >2013-12-09 08:16:51,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f882093 >2013-12-09 08:16:56,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c1f6826 >2013-12-09 08:16:56,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5c1f6826 >2013-12-09 08:16:56,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ad39d94 >2013-12-09 08:16:56,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ad39d94 >2013-12-09 08:17:01,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48486845 >2013-12-09 08:17:02,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 48486845 >2013-12-09 08:17:02,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 455c48ac >2013-12-09 08:17:02,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 455c48ac >2013-12-09 08:17:07,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33c3520 >2013-12-09 08:17:08,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 33c3520 >2013-12-09 08:17:08,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78b18173 >2013-12-09 08:17:08,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78b18173 >2013-12-09 08:17:13,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40d28312 >2013-12-09 08:17:13,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 40d28312 >2013-12-09 08:17:13,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7be68bb >2013-12-09 08:17:14,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7be68bb >2013-12-09 08:17:17,606 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) No up server in cluster >2013-12-09 08:17:17,606 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:17:17,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19f9e8fa >2013-12-09 08:17:17,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterTasksListVDSCommand, return: [], log id: 19f9e8fa >2013-12-09 08:17:19,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b0e386f >2013-12-09 08:17:19,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1b0e386f >2013-12-09 08:17:19,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 358e98fb >2013-12-09 08:17:19,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 358e98fb >2013-12-09 08:17:25,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 151c04b4 >2013-12-09 08:17:25,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 151c04b4 >2013-12-09 08:17:25,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c8b531f >2013-12-09 08:17:25,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c8b531f >2013-12-09 08:17:30,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a1b78b5 >2013-12-09 08:17:31,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4a1b78b5 >2013-12-09 08:17:31,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 745ea259 >2013-12-09 08:17:31,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 745ea259 >2013-12-09 08:17:36,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c40057 >2013-12-09 08:17:37,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c40057 >2013-12-09 08:17:37,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c25c9c5 >2013-12-09 08:17:37,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c25c9c5 >2013-12-09 08:17:42,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 415bca68 >2013-12-09 08:17:42,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 415bca68 >2013-12-09 08:17:42,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75d225e9 >2013-12-09 08:17:43,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75d225e9 >2013-12-09 08:17:48,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 630ec99f >2013-12-09 08:17:48,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 630ec99f >2013-12-09 08:17:48,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10ef8375 >2013-12-09 08:17:48,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10ef8375 >2013-12-09 08:17:53,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66f643b8 >2013-12-09 08:17:54,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 66f643b8 >2013-12-09 08:17:54,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6275dcd3 >2013-12-09 08:17:54,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6275dcd3 >2013-12-09 08:17:59,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a9876 >2013-12-09 08:18:00,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a9876 >2013-12-09 08:18:00,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b940efd >2013-12-09 08:18:00,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b940efd >2013-12-09 08:18:05,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e19d874 >2013-12-09 08:18:05,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6e19d874 >2013-12-09 08:18:05,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54a7b583 >2013-12-09 08:18:06,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54a7b583 >2013-12-09 08:18:11,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 527fae6 >2013-12-09 08:18:11,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 527fae6 >2013-12-09 08:18:11,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7583d5a >2013-12-09 08:18:12,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7583d5a >2013-12-09 08:18:17,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d1bab60 >2013-12-09 08:18:17,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d1bab60 >2013-12-09 08:18:17,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34b511a1 >2013-12-09 08:18:17,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34b511a1 >2013-12-09 08:18:17,895 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-26) No up server in cluster >2013-12-09 08:18:17,895 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-26) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:18:17,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 132ad677 >2013-12-09 08:18:18,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterTasksListVDSCommand, return: [], log id: 132ad677 >2013-12-09 08:18:22,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45aa7dca >2013-12-09 08:18:23,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 45aa7dca >2013-12-09 08:18:23,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ac4c37c >2013-12-09 08:18:23,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ac4c37c >2013-12-09 08:18:28,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 149be34a >2013-12-09 08:18:29,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 149be34a >2013-12-09 08:18:29,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23d94f1 >2013-12-09 08:18:29,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23d94f1 >2013-12-09 08:18:34,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ff70a26 >2013-12-09 08:18:34,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1ff70a26 >2013-12-09 08:18:34,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41af4675 >2013-12-09 08:18:35,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41af4675 >2013-12-09 08:18:40,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78de4997 >2013-12-09 08:18:40,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 78de4997 >2013-12-09 08:18:40,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ab807b4 >2013-12-09 08:18:40,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ab807b4 >2013-12-09 08:18:45,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2abc5b4 >2013-12-09 08:18:46,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2abc5b4 >2013-12-09 08:18:46,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5290651d >2013-12-09 08:18:46,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5290651d >2013-12-09 08:18:51,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 253100ea >2013-12-09 08:18:52,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 253100ea >2013-12-09 08:18:52,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 726c2544 >2013-12-09 08:18:52,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 726c2544 >2013-12-09 08:18:57,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1079c0be >2013-12-09 08:18:58,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1079c0be >2013-12-09 08:18:58,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ff742f7 >2013-12-09 08:18:58,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ff742f7 >2013-12-09 08:19:03,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14c232c2 >2013-12-09 08:19:03,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 14c232c2 >2013-12-09 08:19:03,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e87872c >2013-12-09 08:19:04,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e87872c >2013-12-09 08:19:09,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 28dd322e >2013-12-09 08:19:09,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 28dd322e >2013-12-09 08:19:09,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f9e013 >2013-12-09 08:19:09,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f9e013 >2013-12-09 08:19:14,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a4fb990 >2013-12-09 08:19:15,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1a4fb990 >2013-12-09 08:19:15,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11b8e5dc >2013-12-09 08:19:15,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11b8e5dc >2013-12-09 08:19:18,174 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-90) No up server in cluster >2013-12-09 08:19:18,174 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-90) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:19:18,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 273382df >2013-12-09 08:19:18,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterTasksListVDSCommand, return: [], log id: 273382df >2013-12-09 08:19:20,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58937952 >2013-12-09 08:19:21,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 58937952 >2013-12-09 08:19:21,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b936062 >2013-12-09 08:19:21,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b936062 >2013-12-09 08:19:26,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68a1f006 >2013-12-09 08:19:26,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 68a1f006 >2013-12-09 08:19:26,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7019e9f3 >2013-12-09 08:19:27,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7019e9f3 >2013-12-09 08:19:32,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b03310d >2013-12-09 08:19:32,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b03310d >2013-12-09 08:19:32,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c420a0c >2013-12-09 08:19:32,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c420a0c >2013-12-09 08:19:37,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 447feaa9 >2013-12-09 08:19:38,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 447feaa9 >2013-12-09 08:19:38,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d6eeb30 >2013-12-09 08:19:38,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d6eeb30 >2013-12-09 08:19:43,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5fc01ae5 >2013-12-09 08:19:44,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5fc01ae5 >2013-12-09 08:19:44,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45b484f5 >2013-12-09 08:19:44,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45b484f5 >2013-12-09 08:19:49,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b6e6cb5 >2013-12-09 08:19:50,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b6e6cb5 >2013-12-09 08:19:50,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3975d672 >2013-12-09 08:19:50,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3975d672 >2013-12-09 08:19:55,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69672eee >2013-12-09 08:19:55,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 69672eee >2013-12-09 08:19:55,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65c1d2f6 >2013-12-09 08:19:56,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65c1d2f6 >2013-12-09 08:20:01,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 742812f >2013-12-09 08:20:01,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 742812f >2013-12-09 08:20:01,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3515db5d >2013-12-09 08:20:01,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3515db5d >2013-12-09 08:20:06,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74c553e5 >2013-12-09 08:20:07,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 74c553e5 >2013-12-09 08:20:07,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1079a7d7 >2013-12-09 08:20:07,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1079a7d7 >2013-12-09 08:20:12,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4158e083 >2013-12-09 08:20:13,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4158e083 >2013-12-09 08:20:13,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 564ee32b >2013-12-09 08:20:13,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 564ee32b >2013-12-09 08:20:18,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c42f0ea >2013-12-09 08:20:18,449 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-66) No up server in cluster >2013-12-09 08:20:18,449 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-66) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:20:18,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11ed172a >2013-12-09 08:20:19,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterTasksListVDSCommand, return: [], log id: 11ed172a >2013-12-09 08:20:19,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4c42f0ea >2013-12-09 08:20:19,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4df77595 >2013-12-09 08:20:19,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4df77595 >2013-12-09 08:20:24,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37fcc5d7 >2013-12-09 08:20:25,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 37fcc5d7 >2013-12-09 08:20:25,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d2f9b58 >2013-12-09 08:20:25,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d2f9b58 >2013-12-09 08:20:30,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18d9899 >2013-12-09 08:20:30,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 18d9899 >2013-12-09 08:20:30,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1070eb5c >2013-12-09 08:20:31,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1070eb5c >2013-12-09 08:20:36,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c2f0b0d >2013-12-09 08:20:36,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3c2f0b0d >2013-12-09 08:20:36,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2de7617b >2013-12-09 08:20:36,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2de7617b >2013-12-09 08:20:41,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53980cb4 >2013-12-09 08:20:42,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 53980cb4 >2013-12-09 08:20:42,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 22611b93 >2013-12-09 08:20:42,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22611b93 >2013-12-09 08:20:47,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a30f1f4 >2013-12-09 08:20:48,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2a30f1f4 >2013-12-09 08:20:48,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67069608 >2013-12-09 08:20:48,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67069608 >2013-12-09 08:20:53,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 393097af >2013-12-09 08:20:53,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 393097af >2013-12-09 08:20:53,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 715614e8 >2013-12-09 08:20:54,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 715614e8 >2013-12-09 08:20:59,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3371b200 >2013-12-09 08:20:59,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3371b200 >2013-12-09 08:20:59,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 781028e2 >2013-12-09 08:20:59,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 781028e2 >2013-12-09 08:21:04,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2951abe7 >2013-12-09 08:21:05,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2951abe7 >2013-12-09 08:21:05,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5bdb3053 >2013-12-09 08:21:05,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5bdb3053 >2013-12-09 08:21:10,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ca4a4ae >2013-12-09 08:21:11,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5ca4a4ae >2013-12-09 08:21:11,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42f519e1 >2013-12-09 08:21:11,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42f519e1 >2013-12-09 08:21:16,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 489274bd >2013-12-09 08:21:17,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 489274bd >2013-12-09 08:21:17,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7030e45a >2013-12-09 08:21:17,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7030e45a >2013-12-09 08:21:19,131 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-97) No up server in cluster >2013-12-09 08:21:19,132 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-97) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:21:19,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c7652e >2013-12-09 08:21:19,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3c7652e >2013-12-09 08:21:22,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b042f6f >2013-12-09 08:21:22,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b042f6f >2013-12-09 08:21:22,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78463df3 >2013-12-09 08:21:23,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78463df3 >2013-12-09 08:21:28,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a3b1faa >2013-12-09 08:21:28,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4a3b1faa >2013-12-09 08:21:28,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21e74b0c >2013-12-09 08:21:29,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21e74b0c >2013-12-09 08:21:34,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e0351a7 >2013-12-09 08:21:34,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e0351a7 >2013-12-09 08:21:34,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c21b88e >2013-12-09 08:21:35,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c21b88e >2013-12-09 08:21:40,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3cf4c380 >2013-12-09 08:21:40,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3cf4c380 >2013-12-09 08:21:40,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1fa676e8 >2013-12-09 08:21:40,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1fa676e8 >2013-12-09 08:21:45,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e7fdef5 >2013-12-09 08:21:46,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4e7fdef5 >2013-12-09 08:21:46,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d455b72 >2013-12-09 08:21:46,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d455b72 >2013-12-09 08:21:51,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43cff0d6 >2013-12-09 08:21:52,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 43cff0d6 >2013-12-09 08:21:52,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27c8fef9 >2013-12-09 08:21:52,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27c8fef9 >2013-12-09 08:21:57,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2cef0516 >2013-12-09 08:21:57,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2cef0516 >2013-12-09 08:21:57,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6610aa19 >2013-12-09 08:21:58,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6610aa19 >2013-12-09 08:22:03,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5322d32 >2013-12-09 08:22:03,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5322d32 >2013-12-09 08:22:03,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: fafae85 >2013-12-09 08:22:03,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: fafae85 >2013-12-09 08:22:08,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 889b947 >2013-12-09 08:22:09,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 889b947 >2013-12-09 08:22:09,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72c8d159 >2013-12-09 08:22:09,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72c8d159 >2013-12-09 08:22:14,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67a74335 >2013-12-09 08:22:15,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 67a74335 >2013-12-09 08:22:15,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c325d36 >2013-12-09 08:22:15,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c325d36 >2013-12-09 08:22:19,408 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-28) No up server in cluster >2013-12-09 08:22:19,408 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-28) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:22:19,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a62bf5f >2013-12-09 08:22:19,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2a62bf5f >2013-12-09 08:22:20,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7583f484 >2013-12-09 08:22:20,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7583f484 >2013-12-09 08:22:20,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5145ea80 >2013-12-09 08:22:21,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5145ea80 >2013-12-09 08:22:26,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4eacdc63 >2013-12-09 08:22:26,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4eacdc63 >2013-12-09 08:22:26,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b3f3763 >2013-12-09 08:22:26,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b3f3763 >2013-12-09 08:22:32,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b572729 >2013-12-09 08:22:32,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1b572729 >2013-12-09 08:22:32,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 440f1218 >2013-12-09 08:22:32,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 440f1218 >2013-12-09 08:22:37,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52e8f4f >2013-12-09 08:22:38,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 52e8f4f >2013-12-09 08:22:38,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2438ccbe >2013-12-09 08:22:38,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2438ccbe >2013-12-09 08:22:43,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d8afd65 >2013-12-09 08:22:44,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5d8afd65 >2013-12-09 08:22:44,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b3fcb9e >2013-12-09 08:22:44,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b3fcb9e >2013-12-09 08:22:49,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18a5ec65 >2013-12-09 08:22:49,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 18a5ec65 >2013-12-09 08:22:49,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c578591 >2013-12-09 08:22:50,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c578591 >2013-12-09 08:22:55,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 770defde >2013-12-09 08:22:55,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 770defde >2013-12-09 08:22:55,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 527020a2 >2013-12-09 08:22:55,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 527020a2 >2013-12-09 08:23:00,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7943e948 >2013-12-09 08:23:01,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7943e948 >2013-12-09 08:23:01,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 648ad09f >2013-12-09 08:23:01,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 648ad09f >2013-12-09 08:23:06,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47427f4f >2013-12-09 08:23:07,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 47427f4f >2013-12-09 08:23:07,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 334a8b7 >2013-12-09 08:23:07,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 334a8b7 >2013-12-09 08:23:12,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ffa1ee4 >2013-12-09 08:23:13,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7ffa1ee4 >2013-12-09 08:23:13,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24656011 >2013-12-09 08:23:13,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24656011 >2013-12-09 08:23:18,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 612d4491 >2013-12-09 08:23:18,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 612d4491 >2013-12-09 08:23:18,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e687ea0 >2013-12-09 08:23:19,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e687ea0 >2013-12-09 08:23:19,692 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-56) No up server in cluster >2013-12-09 08:23:19,692 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-56) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:23:19,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3807c173 >2013-12-09 08:23:19,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3807c173 >2013-12-09 08:23:24,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6716279c >2013-12-09 08:23:24,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6716279c >2013-12-09 08:23:24,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e930a99 >2013-12-09 08:23:24,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e930a99 >2013-12-09 08:23:29,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6fa334d9 >2013-12-09 08:23:30,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6fa334d9 >2013-12-09 08:23:30,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e6ff72 >2013-12-09 08:23:30,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e6ff72 >2013-12-09 08:23:35,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7cd2b64b >2013-12-09 08:23:36,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7cd2b64b >2013-12-09 08:23:36,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f27a115 >2013-12-09 08:23:36,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f27a115 >2013-12-09 08:23:41,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 22094478 >2013-12-09 08:23:41,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 22094478 >2013-12-09 08:23:41,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6fc24dfd >2013-12-09 08:23:42,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6fc24dfd >2013-12-09 08:23:47,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b3ed99a >2013-12-09 08:23:47,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b3ed99a >2013-12-09 08:23:47,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d28364a >2013-12-09 08:23:47,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d28364a >2013-12-09 08:23:52,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59854847 >2013-12-09 08:23:53,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 59854847 >2013-12-09 08:23:53,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 519c7a4b >2013-12-09 08:23:53,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 519c7a4b >2013-12-09 08:23:58,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12e0b69 >2013-12-09 08:23:59,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 12e0b69 >2013-12-09 08:23:59,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21b9c7f >2013-12-09 08:23:59,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21b9c7f >2013-12-09 08:24:04,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b98ff7 >2013-12-09 08:24:05,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3b98ff7 >2013-12-09 08:24:05,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13c77303 >2013-12-09 08:24:05,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13c77303 >2013-12-09 08:24:10,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2483f41 >2013-12-09 08:24:10,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2483f41 >2013-12-09 08:24:10,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f7e2200 >2013-12-09 08:24:11,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f7e2200 >2013-12-09 08:24:16,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72de372f >2013-12-09 08:24:16,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 72de372f >2013-12-09 08:24:16,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 242d1d04 >2013-12-09 08:24:16,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 242d1d04 >2013-12-09 08:24:19,966 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-31) No up server in cluster >2013-12-09 08:24:19,966 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-31) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:24:19,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b55f943 >2013-12-09 08:24:20,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1b55f943 >2013-12-09 08:24:21,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 49528536 >2013-12-09 08:24:22,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 49528536 >2013-12-09 08:24:22,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d079548 >2013-12-09 08:24:22,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d079548 >2013-12-09 08:24:27,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 458ea5fa >2013-12-09 08:24:28,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 458ea5fa >2013-12-09 08:24:28,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: bbdb64c >2013-12-09 08:24:28,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: bbdb64c >2013-12-09 08:24:33,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30cbb298 >2013-12-09 08:24:34,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 30cbb298 >2013-12-09 08:24:34,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57cf9e82 >2013-12-09 08:24:34,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57cf9e82 >2013-12-09 08:24:39,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57700483 >2013-12-09 08:24:39,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 57700483 >2013-12-09 08:24:39,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7688f1d >2013-12-09 08:24:40,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7688f1d >2013-12-09 08:24:45,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f15410 >2013-12-09 08:24:45,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f15410 >2013-12-09 08:24:45,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59b8dc9f >2013-12-09 08:24:45,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59b8dc9f >2013-12-09 08:24:50,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c74c8b5 >2013-12-09 08:24:51,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3c74c8b5 >2013-12-09 08:24:51,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71b93cb2 >2013-12-09 08:24:51,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71b93cb2 >2013-12-09 08:24:56,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b8fff84 >2013-12-09 08:24:57,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5b8fff84 >2013-12-09 08:24:57,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c731dd4 >2013-12-09 08:24:57,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c731dd4 >2013-12-09 08:25:02,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63b312f3 >2013-12-09 08:25:02,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 63b312f3 >2013-12-09 08:25:02,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f04bb7f >2013-12-09 08:25:03,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f04bb7f >2013-12-09 08:25:08,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: bb1446d >2013-12-09 08:25:08,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: bb1446d >2013-12-09 08:25:08,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 552511ea >2013-12-09 08:25:08,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 552511ea >2013-12-09 08:25:13,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12c454e >2013-12-09 08:25:14,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 12c454e >2013-12-09 08:25:14,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b64e662 >2013-12-09 08:25:14,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b64e662 >2013-12-09 08:25:19,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 357e7bf0 >2013-12-09 08:25:20,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 357e7bf0 >2013-12-09 08:25:20,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38bb2a44 >2013-12-09 08:25:20,240 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-65) No up server in cluster >2013-12-09 08:25:20,241 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-65) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:25:20,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 612c2465 >2013-12-09 08:25:20,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38bb2a44 >2013-12-09 08:25:20,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterTasksListVDSCommand, return: [], log id: 612c2465 >2013-12-09 08:25:25,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c1e3809 >2013-12-09 08:25:25,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6c1e3809 >2013-12-09 08:25:25,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77c9a127 >2013-12-09 08:25:26,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77c9a127 >2013-12-09 08:25:31,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 28a6a28e >2013-12-09 08:25:31,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 28a6a28e >2013-12-09 08:25:31,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6dec6f3b >2013-12-09 08:25:32,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6dec6f3b >2013-12-09 08:25:37,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 227cfc18 >2013-12-09 08:25:37,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 227cfc18 >2013-12-09 08:25:37,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 24522cc >2013-12-09 08:25:37,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24522cc >2013-12-09 08:25:42,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18e50f84 >2013-12-09 08:25:43,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 18e50f84 >2013-12-09 08:25:43,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7adc1414 >2013-12-09 08:25:43,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7adc1414 >2013-12-09 08:25:48,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40e6afd9 >2013-12-09 08:25:49,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 40e6afd9 >2013-12-09 08:25:49,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5028fc1e >2013-12-09 08:25:49,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5028fc1e >2013-12-09 08:25:54,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e3362e2 >2013-12-09 08:25:54,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7e3362e2 >2013-12-09 08:25:54,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1fbdc1fd >2013-12-09 08:25:55,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1fbdc1fd >2013-12-09 08:26:00,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f7c9268 >2013-12-09 08:26:00,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f7c9268 >2013-12-09 08:26:00,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9c45299 >2013-12-09 08:26:00,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9c45299 >2013-12-09 08:26:05,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b3a171d >2013-12-09 08:26:06,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1b3a171d >2013-12-09 08:26:06,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7bdc4c8d >2013-12-09 08:26:06,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7bdc4c8d >2013-12-09 08:26:11,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39a5a5c >2013-12-09 08:26:12,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 39a5a5c >2013-12-09 08:26:12,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2924bb90 >2013-12-09 08:26:12,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2924bb90 >2013-12-09 08:26:17,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ce25578 >2013-12-09 08:26:18,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ce25578 >2013-12-09 08:26:18,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e5482f9 >2013-12-09 08:26:18,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e5482f9 >2013-12-09 08:26:20,516 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-59) No up server in cluster >2013-12-09 08:26:20,517 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-59) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:26:20,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d284df2 >2013-12-09 08:26:20,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7d284df2 >2013-12-09 08:26:23,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d511acb >2013-12-09 08:26:23,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d511acb >2013-12-09 08:26:23,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 762c33f1 >2013-12-09 08:26:24,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 762c33f1 >2013-12-09 08:26:29,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43cb4db1 >2013-12-09 08:26:29,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 43cb4db1 >2013-12-09 08:26:29,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a4796ac >2013-12-09 08:26:29,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a4796ac >2013-12-09 08:26:34,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5889a764 >2013-12-09 08:26:35,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5889a764 >2013-12-09 08:26:35,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52d6560b >2013-12-09 08:26:35,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52d6560b >2013-12-09 08:26:40,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56c9f976 >2013-12-09 08:26:41,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 56c9f976 >2013-12-09 08:26:41,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18de391d >2013-12-09 08:26:41,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18de391d >2013-12-09 08:26:46,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e9562da >2013-12-09 08:26:46,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1e9562da >2013-12-09 08:26:46,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 300dd47c >2013-12-09 08:26:47,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 300dd47c >2013-12-09 08:26:52,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65b50d7 >2013-12-09 08:26:52,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 65b50d7 >2013-12-09 08:26:52,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11c81fdc >2013-12-09 08:26:52,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11c81fdc >2013-12-09 08:26:57,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c742e1f >2013-12-09 08:26:58,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c742e1f >2013-12-09 08:26:58,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 427cff12 >2013-12-09 08:26:58,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 427cff12 >2013-12-09 08:27:03,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28cf133c >2013-12-09 08:27:04,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 28cf133c >2013-12-09 08:27:04,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 574de51b >2013-12-09 08:27:04,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 574de51b >2013-12-09 08:27:09,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 536f75b0 >2013-12-09 08:27:10,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 536f75b0 >2013-12-09 08:27:10,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5919aef6 >2013-12-09 08:27:10,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5919aef6 >2013-12-09 08:27:15,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 479e9679 >2013-12-09 08:27:15,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 479e9679 >2013-12-09 08:27:15,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c825be2 >2013-12-09 08:27:16,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c825be2 >2013-12-09 08:27:20,787 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-24) No up server in cluster >2013-12-09 08:27:20,787 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-24) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:27:20,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38c8c428 >2013-12-09 08:27:21,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterTasksListVDSCommand, return: [], log id: 38c8c428 >2013-12-09 08:27:21,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18732fa >2013-12-09 08:27:21,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 18732fa >2013-12-09 08:27:21,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 619c8762 >2013-12-09 08:27:21,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 619c8762 >2013-12-09 08:27:26,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 607d3422 >2013-12-09 08:27:27,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 607d3422 >2013-12-09 08:27:27,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 871405b >2013-12-09 08:27:27,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 871405b >2013-12-09 08:27:32,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c166b22 >2013-12-09 08:27:33,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5c166b22 >2013-12-09 08:27:33,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 524598a5 >2013-12-09 08:27:33,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 524598a5 >2013-12-09 08:27:38,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e030578 >2013-12-09 08:27:38,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4e030578 >2013-12-09 08:27:38,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 14c94aac >2013-12-09 08:27:39,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14c94aac >2013-12-09 08:27:44,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d529018 >2013-12-09 08:27:44,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d529018 >2013-12-09 08:27:44,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b107f2d >2013-12-09 08:27:44,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b107f2d >2013-12-09 08:27:50,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7407893a >2013-12-09 08:27:50,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7407893a >2013-12-09 08:27:50,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 382c357c >2013-12-09 08:27:50,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 382c357c >2013-12-09 08:27:55,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3462103d >2013-12-09 08:27:56,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3462103d >2013-12-09 08:27:56,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a1edd51 >2013-12-09 08:27:56,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a1edd51 >2013-12-09 08:28:01,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f2fae17 >2013-12-09 08:28:02,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6f2fae17 >2013-12-09 08:28:02,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4fb88598 >2013-12-09 08:28:02,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fb88598 >2013-12-09 08:28:07,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63d0a915 >2013-12-09 08:28:07,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 63d0a915 >2013-12-09 08:28:07,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33925193 >2013-12-09 08:28:08,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33925193 >2013-12-09 08:28:13,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17b53016 >2013-12-09 08:28:13,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 17b53016 >2013-12-09 08:28:13,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e25c4e7 >2013-12-09 08:28:13,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e25c4e7 >2013-12-09 08:28:18,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 384ce05a >2013-12-09 08:28:19,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 384ce05a >2013-12-09 08:28:19,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 254b9f06 >2013-12-09 08:28:19,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 254b9f06 >2013-12-09 08:28:21,078 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-21) No up server in cluster >2013-12-09 08:28:21,078 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-21) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:28:21,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79d9e814 >2013-12-09 08:28:21,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterTasksListVDSCommand, return: [], log id: 79d9e814 >2013-12-09 08:28:24,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 580d5ee4 >2013-12-09 08:28:25,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 580d5ee4 >2013-12-09 08:28:25,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49de5ce3 >2013-12-09 08:28:25,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49de5ce3 >2013-12-09 08:28:30,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32b57ac6 >2013-12-09 08:28:30,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 32b57ac6 >2013-12-09 08:28:30,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76beb7eb >2013-12-09 08:28:31,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76beb7eb >2013-12-09 08:28:36,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4cf4b752 >2013-12-09 08:28:36,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4cf4b752 >2013-12-09 08:28:36,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4eee8a39 >2013-12-09 08:28:36,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4eee8a39 >2013-12-09 08:28:41,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5930d603 >2013-12-09 08:28:42,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5930d603 >2013-12-09 08:28:42,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69521b6f >2013-12-09 08:28:42,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69521b6f >2013-12-09 08:28:47,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6bb1d449 >2013-12-09 08:28:48,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6bb1d449 >2013-12-09 08:28:48,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b4e131c >2013-12-09 08:28:48,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b4e131c >2013-12-09 08:28:53,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47ef08d7 >2013-12-09 08:28:54,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 47ef08d7 >2013-12-09 08:28:54,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25cd521 >2013-12-09 08:28:54,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25cd521 >2013-12-09 08:28:59,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46c757de >2013-12-09 08:28:59,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 46c757de >2013-12-09 08:28:59,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63c585e6 >2013-12-09 08:29:00,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63c585e6 >2013-12-09 08:29:05,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54cece8d >2013-12-09 08:29:05,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 54cece8d >2013-12-09 08:29:05,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a074442 >2013-12-09 08:29:05,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a074442 >2013-12-09 08:29:10,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74a43550 >2013-12-09 08:29:11,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 74a43550 >2013-12-09 08:29:11,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a7f68f0 >2013-12-09 08:29:11,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a7f68f0 >2013-12-09 08:29:16,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44c2f11b >2013-12-09 08:29:17,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 44c2f11b >2013-12-09 08:29:17,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7cf8495a >2013-12-09 08:29:17,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7cf8495a >2013-12-09 08:29:21,357 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-70) No up server in cluster >2013-12-09 08:29:21,357 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-70) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:29:21,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5daf1771 >2013-12-09 08:29:21,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5daf1771 >2013-12-09 08:29:22,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1de8d389 >2013-12-09 08:29:22,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1de8d389 >2013-12-09 08:29:22,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 710e8c2e >2013-12-09 08:29:23,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 710e8c2e >2013-12-09 08:29:28,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46aa2d97 >2013-12-09 08:29:28,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 46aa2d97 >2013-12-09 08:29:28,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37e14355 >2013-12-09 08:29:29,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37e14355 >2013-12-09 08:29:34,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ac39b47 >2013-12-09 08:29:34,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ac39b47 >2013-12-09 08:29:34,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6383a00d >2013-12-09 08:29:34,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6383a00d >2013-12-09 08:29:39,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1792f7bc >2013-12-09 08:29:40,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1792f7bc >2013-12-09 08:29:40,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 118c4af5 >2013-12-09 08:29:40,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 118c4af5 >2013-12-09 08:29:45,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 530a0f6d >2013-12-09 08:29:46,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 530a0f6d >2013-12-09 08:29:46,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7cb619ce >2013-12-09 08:29:46,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7cb619ce >2013-12-09 08:29:51,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6fc6177d >2013-12-09 08:29:51,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6fc6177d >2013-12-09 08:29:51,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3545f3ef >2013-12-09 08:29:52,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3545f3ef >2013-12-09 08:29:57,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65dedfb2 >2013-12-09 08:29:57,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 65dedfb2 >2013-12-09 08:29:57,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ff7d60d >2013-12-09 08:29:57,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ff7d60d >2013-12-09 08:30:02,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e4eec4c >2013-12-09 08:30:03,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3e4eec4c >2013-12-09 08:30:03,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f3724f9 >2013-12-09 08:30:03,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f3724f9 >2013-12-09 08:30:08,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 135e6ba1 >2013-12-09 08:30:09,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 135e6ba1 >2013-12-09 08:30:09,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ec97496 >2013-12-09 08:30:09,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ec97496 >2013-12-09 08:30:14,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78d35634 >2013-12-09 08:30:15,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 78d35634 >2013-12-09 08:30:15,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b290a9e >2013-12-09 08:30:15,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b290a9e >2013-12-09 08:30:20,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19a2d10f >2013-12-09 08:30:20,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19a2d10f >2013-12-09 08:30:20,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3fcf5557 >2013-12-09 08:30:21,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3fcf5557 >2013-12-09 08:30:21,638 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-31) No up server in cluster >2013-12-09 08:30:21,638 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-31) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:30:21,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c711695 >2013-12-09 08:30:21,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2c711695 >2013-12-09 08:30:26,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48f10954 >2013-12-09 08:30:26,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 48f10954 >2013-12-09 08:30:26,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ea2ac37 >2013-12-09 08:30:26,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ea2ac37 >2013-12-09 08:30:31,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43fe5bdd >2013-12-09 08:30:32,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 43fe5bdd >2013-12-09 08:30:32,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4112af0f >2013-12-09 08:30:32,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4112af0f >2013-12-09 08:30:37,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 770f8240 >2013-12-09 08:30:38,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 770f8240 >2013-12-09 08:30:38,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67d32562 >2013-12-09 08:30:38,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67d32562 >2013-12-09 08:30:43,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a2c8ed7 >2013-12-09 08:30:43,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3a2c8ed7 >2013-12-09 08:30:43,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42878141 >2013-12-09 08:30:44,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42878141 >2013-12-09 08:30:49,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6102d9ad >2013-12-09 08:30:49,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6102d9ad >2013-12-09 08:30:49,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47531b00 >2013-12-09 08:30:49,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47531b00 >2013-12-09 08:30:54,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e521400 >2013-12-09 08:30:55,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e521400 >2013-12-09 08:30:55,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7034ae63 >2013-12-09 08:30:55,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7034ae63 >2013-12-09 08:31:00,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7cdad997 >2013-12-09 08:31:01,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7cdad997 >2013-12-09 08:31:01,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4df58c0b >2013-12-09 08:31:01,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4df58c0b >2013-12-09 08:31:06,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 273095e0 >2013-12-09 08:31:06,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 273095e0 >2013-12-09 08:31:06,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4734b036 >2013-12-09 08:31:07,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4734b036 >2013-12-09 08:31:12,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2cae0164 >2013-12-09 08:31:12,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2cae0164 >2013-12-09 08:31:12,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 322f00d1 >2013-12-09 08:31:12,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 322f00d1 >2013-12-09 08:31:18,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 703b4e26 >2013-12-09 08:31:18,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 703b4e26 >2013-12-09 08:31:18,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48b85f1e >2013-12-09 08:31:18,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48b85f1e >2013-12-09 08:31:21,923 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-37) No up server in cluster >2013-12-09 08:31:21,924 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-37) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:31:21,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4968d569 >2013-12-09 08:31:22,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4968d569 >2013-12-09 08:31:23,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7826cc1d >2013-12-09 08:31:24,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7826cc1d >2013-12-09 08:31:24,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7bf2287d >2013-12-09 08:31:24,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7bf2287d >2013-12-09 08:31:29,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 774cfe28 >2013-12-09 08:31:30,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 774cfe28 >2013-12-09 08:31:30,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f4384f9 >2013-12-09 08:31:30,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f4384f9 >2013-12-09 08:31:35,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2cba7df3 >2013-12-09 08:31:35,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2cba7df3 >2013-12-09 08:31:35,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c8a5fa1 >2013-12-09 08:31:36,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c8a5fa1 >2013-12-09 08:31:41,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5564830c >2013-12-09 08:31:41,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5564830c >2013-12-09 08:31:41,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e7fd67d >2013-12-09 08:31:41,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e7fd67d >2013-12-09 08:31:46,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3566e04c >2013-12-09 08:31:47,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3566e04c >2013-12-09 08:31:47,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 620cb8fd >2013-12-09 08:31:47,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 620cb8fd >2013-12-09 08:31:52,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66f460d4 >2013-12-09 08:31:53,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 66f460d4 >2013-12-09 08:31:53,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d0f8e5b >2013-12-09 08:31:53,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d0f8e5b >2013-12-09 08:31:58,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23b88df4 >2013-12-09 08:31:59,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 23b88df4 >2013-12-09 08:31:59,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d269907 >2013-12-09 08:31:59,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d269907 >2013-12-09 08:32:04,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38be42cc >2013-12-09 08:32:04,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 38be42cc >2013-12-09 08:32:04,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68f49d06 >2013-12-09 08:32:05,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68f49d06 >2013-12-09 08:32:10,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67b141ab >2013-12-09 08:32:10,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 67b141ab >2013-12-09 08:32:10,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e22c1d5 >2013-12-09 08:32:10,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e22c1d5 >2013-12-09 08:32:15,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71a6887b >2013-12-09 08:32:16,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 71a6887b >2013-12-09 08:32:16,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c31fa7c >2013-12-09 08:32:16,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c31fa7c >2013-12-09 08:32:21,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70baba8f >2013-12-09 08:32:22,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 70baba8f >2013-12-09 08:32:22,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 390e657d >2013-12-09 08:32:22,208 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-64) No up server in cluster >2013-12-09 08:32:22,208 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-64) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:32:22,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d4b322 >2013-12-09 08:32:22,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 390e657d >2013-12-09 08:32:22,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6d4b322 >2013-12-09 08:32:27,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4828a3e6 >2013-12-09 08:32:27,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4828a3e6 >2013-12-09 08:32:27,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 393230d >2013-12-09 08:32:28,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 393230d >2013-12-09 08:32:33,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ec2209b >2013-12-09 08:32:33,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ec2209b >2013-12-09 08:32:33,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65634d5b >2013-12-09 08:32:34,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65634d5b >2013-12-09 08:32:39,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3541d4a7 >2013-12-09 08:32:39,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3541d4a7 >2013-12-09 08:32:39,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53e046fa >2013-12-09 08:32:39,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53e046fa >2013-12-09 08:32:44,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e4df1f9 >2013-12-09 08:32:45,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2e4df1f9 >2013-12-09 08:32:45,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13057847 >2013-12-09 08:32:45,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13057847 >2013-12-09 08:32:50,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ca2bfb0 >2013-12-09 08:32:51,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5ca2bfb0 >2013-12-09 08:32:51,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b4869c8 >2013-12-09 08:32:51,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b4869c8 >2013-12-09 08:32:56,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6835a67a >2013-12-09 08:32:56,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6835a67a >2013-12-09 08:32:56,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c4c63b5 >2013-12-09 08:32:57,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c4c63b5 >2013-12-09 08:33:02,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1726155d >2013-12-09 08:33:02,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1726155d >2013-12-09 08:33:02,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 681feeeb >2013-12-09 08:33:02,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 681feeeb >2013-12-09 08:33:07,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e2ba423 >2013-12-09 08:33:08,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e2ba423 >2013-12-09 08:33:08,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e230112 >2013-12-09 08:33:08,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e230112 >2013-12-09 08:33:13,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6cd82ad0 >2013-12-09 08:33:14,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6cd82ad0 >2013-12-09 08:33:14,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 447cd33c >2013-12-09 08:33:14,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 447cd33c >2013-12-09 08:33:19,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b77d2e4 >2013-12-09 08:33:19,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b77d2e4 >2013-12-09 08:33:19,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3edf3e4d >2013-12-09 08:33:20,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3edf3e4d >2013-12-09 08:33:22,469 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-54) No up server in cluster >2013-12-09 08:33:22,469 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-54) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:33:22,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: dde916e >2013-12-09 08:33:22,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterTasksListVDSCommand, return: [], log id: dde916e >2013-12-09 08:33:25,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73e75a34 >2013-12-09 08:33:25,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 73e75a34 >2013-12-09 08:33:25,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ba48bd1 >2013-12-09 08:33:26,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ba48bd1 >2013-12-09 08:33:31,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fc570fe >2013-12-09 08:33:31,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7fc570fe >2013-12-09 08:33:31,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 704c3cb6 >2013-12-09 08:33:31,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 704c3cb6 >2013-12-09 08:33:36,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 683c1af >2013-12-09 08:33:37,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 683c1af >2013-12-09 08:33:37,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77dad4bb >2013-12-09 08:33:37,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77dad4bb >2013-12-09 08:33:42,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12478b67 >2013-12-09 08:33:43,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 12478b67 >2013-12-09 08:33:43,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5dc479dc >2013-12-09 08:33:43,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5dc479dc >2013-12-09 08:33:48,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55dd825b >2013-12-09 08:33:48,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 55dd825b >2013-12-09 08:33:48,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f222ef6 >2013-12-09 08:33:49,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f222ef6 >2013-12-09 08:33:54,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23fb5da0 >2013-12-09 08:33:54,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 23fb5da0 >2013-12-09 08:33:54,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b12c6e1 >2013-12-09 08:33:54,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b12c6e1 >2013-12-09 08:33:59,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6dbe6071 >2013-12-09 08:34:00,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6dbe6071 >2013-12-09 08:34:00,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31bc6342 >2013-12-09 08:34:00,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31bc6342 >2013-12-09 08:34:05,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3dbb3c77 >2013-12-09 08:34:06,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3dbb3c77 >2013-12-09 08:34:06,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72b81796 >2013-12-09 08:34:06,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72b81796 >2013-12-09 08:34:11,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 93bd509 >2013-12-09 08:34:12,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 93bd509 >2013-12-09 08:34:12,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d16685a >2013-12-09 08:34:12,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d16685a >2013-12-09 08:34:17,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 320acf85 >2013-12-09 08:34:17,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 320acf85 >2013-12-09 08:34:17,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3670f89 >2013-12-09 08:34:18,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3670f89 >2013-12-09 08:34:22,768 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) No up server in cluster >2013-12-09 08:34:22,768 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:34:22,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b410398 >2013-12-09 08:34:23,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b1202ec >2013-12-09 08:34:23,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1b410398 >2013-12-09 08:34:23,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b1202ec >2013-12-09 08:34:23,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 575791c >2013-12-09 08:34:23,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 575791c >2013-12-09 08:34:28,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5df0b422 >2013-12-09 08:34:29,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5df0b422 >2013-12-09 08:34:29,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: fccdd41 >2013-12-09 08:34:29,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: fccdd41 >2013-12-09 08:34:34,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7791ffda >2013-12-09 08:34:35,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7791ffda >2013-12-09 08:34:35,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c544f83 >2013-12-09 08:34:35,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c544f83 >2013-12-09 08:34:40,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6dc36795 >2013-12-09 08:34:40,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6dc36795 >2013-12-09 08:34:40,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1670cc2b >2013-12-09 08:34:41,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1670cc2b >2013-12-09 08:34:46,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b59903a >2013-12-09 08:34:46,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1b59903a >2013-12-09 08:34:46,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 14e99934 >2013-12-09 08:34:46,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14e99934 >2013-12-09 08:34:51,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19ceb4e4 >2013-12-09 08:34:52,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 19ceb4e4 >2013-12-09 08:34:52,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 742f3675 >2013-12-09 08:34:52,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 742f3675 >2013-12-09 08:34:57,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5093bcfa >2013-12-09 08:34:58,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5093bcfa >2013-12-09 08:34:58,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1cdc58e2 >2013-12-09 08:34:58,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1cdc58e2 >2013-12-09 08:35:03,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75631c02 >2013-12-09 08:35:03,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 75631c02 >2013-12-09 08:35:03,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d25289b >2013-12-09 08:35:04,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d25289b >2013-12-09 08:35:09,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c351433 >2013-12-09 08:35:09,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c351433 >2013-12-09 08:35:09,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3497e497 >2013-12-09 08:35:09,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3497e497 >2013-12-09 08:35:15,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1519bc42 >2013-12-09 08:35:15,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1519bc42 >2013-12-09 08:35:15,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d4314ab >2013-12-09 08:35:15,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d4314ab >2013-12-09 08:35:20,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 169fdf02 >2013-12-09 08:35:21,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 169fdf02 >2013-12-09 08:35:21,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d8087ad >2013-12-09 08:35:21,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d8087ad >2013-12-09 08:35:23,037 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-46) No up server in cluster >2013-12-09 08:35:23,038 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-46) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:35:23,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f62bd99 >2013-12-09 08:35:23,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3f62bd99 >2013-12-09 08:35:26,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66a0d42f >2013-12-09 08:35:27,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 66a0d42f >2013-12-09 08:35:27,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8b994ea >2013-12-09 08:35:27,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8b994ea >2013-12-09 08:35:32,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 302dcd7a >2013-12-09 08:35:32,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 302dcd7a >2013-12-09 08:35:32,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a2d0707 >2013-12-09 08:35:33,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a2d0707 >2013-12-09 08:35:38,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67777478 >2013-12-09 08:35:38,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 67777478 >2013-12-09 08:35:38,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42558ae7 >2013-12-09 08:35:38,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42558ae7 >2013-12-09 08:35:43,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33b67011 >2013-12-09 08:35:44,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 33b67011 >2013-12-09 08:35:44,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6cc2a26 >2013-12-09 08:35:44,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6cc2a26 >2013-12-09 08:35:49,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41f2ff60 >2013-12-09 08:35:50,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 41f2ff60 >2013-12-09 08:35:50,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1938bada >2013-12-09 08:35:50,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1938bada >2013-12-09 08:35:55,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3625ecd4 >2013-12-09 08:35:55,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3625ecd4 >2013-12-09 08:35:55,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5788305a >2013-12-09 08:35:56,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5788305a >2013-12-09 08:36:01,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33c6695a >2013-12-09 08:36:01,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 33c6695a >2013-12-09 08:36:01,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78a1e61f >2013-12-09 08:36:02,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78a1e61f >2013-12-09 08:36:07,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1adf2002 >2013-12-09 08:36:07,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1adf2002 >2013-12-09 08:36:07,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a028724 >2013-12-09 08:36:07,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a028724 >2013-12-09 08:36:12,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f43462c >2013-12-09 08:36:13,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f43462c >2013-12-09 08:36:13,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5483e868 >2013-12-09 08:36:13,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5483e868 >2013-12-09 08:36:18,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5286312a >2013-12-09 08:36:19,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5286312a >2013-12-09 08:36:19,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 598f5328 >2013-12-09 08:36:19,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 598f5328 >2013-12-09 08:36:23,318 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-57) No up server in cluster >2013-12-09 08:36:23,318 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-57) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:36:23,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 84b19cc >2013-12-09 08:36:23,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterTasksListVDSCommand, return: [], log id: 84b19cc >2013-12-09 08:36:24,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1dcd751f >2013-12-09 08:36:24,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1dcd751f >2013-12-09 08:36:24,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70c2fb7e >2013-12-09 08:36:25,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70c2fb7e >2013-12-09 08:36:30,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2335ad9f >2013-12-09 08:36:30,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2335ad9f >2013-12-09 08:36:30,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58348693 >2013-12-09 08:36:30,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58348693 >2013-12-09 08:36:35,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6226c3bc >2013-12-09 08:36:36,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6226c3bc >2013-12-09 08:36:36,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 44e59e7c >2013-12-09 08:36:36,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44e59e7c >2013-12-09 08:36:41,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4cfc44bf >2013-12-09 08:36:42,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4cfc44bf >2013-12-09 08:36:42,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3444d72b >2013-12-09 08:36:42,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3444d72b >2013-12-09 08:36:47,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70ee8e62 >2013-12-09 08:36:48,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 70ee8e62 >2013-12-09 08:36:48,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6050d94b >2013-12-09 08:36:48,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6050d94b >2013-12-09 08:36:53,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ff8bf7e >2013-12-09 08:36:53,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6ff8bf7e >2013-12-09 08:36:53,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 509911e4 >2013-12-09 08:36:54,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 509911e4 >2013-12-09 08:36:59,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b86d0d5 >2013-12-09 08:36:59,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b86d0d5 >2013-12-09 08:36:59,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7bf579ae >2013-12-09 08:36:59,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7bf579ae >2013-12-09 08:37:04,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55212cb3 >2013-12-09 08:37:05,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 55212cb3 >2013-12-09 08:37:05,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46eb2ac3 >2013-12-09 08:37:05,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46eb2ac3 >2013-12-09 08:37:10,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 81a60a0 >2013-12-09 08:37:11,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 81a60a0 >2013-12-09 08:37:11,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27847806 >2013-12-09 08:37:11,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27847806 >2013-12-09 08:37:16,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c31abf5 >2013-12-09 08:37:16,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2c31abf5 >2013-12-09 08:37:16,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f8dfefc >2013-12-09 08:37:17,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f8dfefc >2013-12-09 08:37:22,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 570e7d1c >2013-12-09 08:37:22,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 570e7d1c >2013-12-09 08:37:22,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c5b6bf3 >2013-12-09 08:37:22,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c5b6bf3 >2013-12-09 08:37:23,594 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-2) No up server in cluster >2013-12-09 08:37:23,594 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-2) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:37:23,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d0f1233 >2013-12-09 08:37:23,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7d0f1233 >2013-12-09 08:37:27,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 695e2e11 >2013-12-09 08:37:28,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 695e2e11 >2013-12-09 08:37:28,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6375ba07 >2013-12-09 08:37:28,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6375ba07 >2013-12-09 08:37:33,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 219d816f >2013-12-09 08:37:34,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 219d816f >2013-12-09 08:37:34,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c793d19 >2013-12-09 08:37:34,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c793d19 >2013-12-09 08:37:39,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 193c7959 >2013-12-09 08:37:39,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 193c7959 >2013-12-09 08:37:39,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11e80cc2 >2013-12-09 08:37:40,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11e80cc2 >2013-12-09 08:37:45,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78f18764 >2013-12-09 08:37:45,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 78f18764 >2013-12-09 08:37:45,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4fdece79 >2013-12-09 08:37:46,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fdece79 >2013-12-09 08:37:51,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c974d2b >2013-12-09 08:37:51,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2c974d2b >2013-12-09 08:37:51,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5cf0af07 >2013-12-09 08:37:51,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cf0af07 >2013-12-09 08:37:56,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 677373e5 >2013-12-09 08:37:57,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 677373e5 >2013-12-09 08:37:57,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7def5506 >2013-12-09 08:37:57,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7def5506 >2013-12-09 08:38:02,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78e64b3c >2013-12-09 08:38:03,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 78e64b3c >2013-12-09 08:38:03,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7de2961e >2013-12-09 08:38:03,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7de2961e >2013-12-09 08:38:08,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3800c2ea >2013-12-09 08:38:08,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3800c2ea >2013-12-09 08:38:08,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c2cae3c >2013-12-09 08:38:09,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c2cae3c >2013-12-09 08:38:14,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d714137 >2013-12-09 08:38:14,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d714137 >2013-12-09 08:38:14,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7daa198 >2013-12-09 08:38:14,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7daa198 >2013-12-09 08:38:19,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1039f0df >2013-12-09 08:38:20,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1039f0df >2013-12-09 08:38:20,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 503797ca >2013-12-09 08:38:20,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 503797ca >2013-12-09 08:38:23,876 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-100) No up server in cluster >2013-12-09 08:38:23,876 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-100) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:38:23,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f3ea81e >2013-12-09 08:38:24,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1f3ea81e >2013-12-09 08:38:25,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62ed06cc >2013-12-09 08:38:26,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 62ed06cc >2013-12-09 08:38:26,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e8d6917 >2013-12-09 08:38:26,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e8d6917 >2013-12-09 08:38:31,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 606a0951 >2013-12-09 08:38:31,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 606a0951 >2013-12-09 08:38:31,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66c43d9c >2013-12-09 08:38:32,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66c43d9c >2013-12-09 08:38:37,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 250b4d46 >2013-12-09 08:38:37,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 250b4d46 >2013-12-09 08:38:37,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f134f9e >2013-12-09 08:38:38,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f134f9e >2013-12-09 08:38:43,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 131d70d7 >2013-12-09 08:38:43,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 131d70d7 >2013-12-09 08:38:43,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23829f0 >2013-12-09 08:38:43,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23829f0 >2013-12-09 08:38:48,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e472f61 >2013-12-09 08:38:49,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: e472f61 >2013-12-09 08:38:49,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66a33de8 >2013-12-09 08:38:49,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66a33de8 >2013-12-09 08:38:54,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57aba08f >2013-12-09 08:38:55,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 57aba08f >2013-12-09 08:38:55,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33af6d20 >2013-12-09 08:38:55,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33af6d20 >2013-12-09 08:39:00,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50d3ddf7 >2013-12-09 08:39:00,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 50d3ddf7 >2013-12-09 08:39:00,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6dfa29d2 >2013-12-09 08:39:01,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6dfa29d2 >2013-12-09 08:39:06,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14cdbc25 >2013-12-09 08:39:06,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 14cdbc25 >2013-12-09 08:39:06,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46f81857 >2013-12-09 08:39:06,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46f81857 >2013-12-09 08:39:11,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6935addc >2013-12-09 08:39:12,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6935addc >2013-12-09 08:39:12,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 323731f >2013-12-09 08:39:12,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 323731f >2013-12-09 08:39:17,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c0a7c58 >2013-12-09 08:39:18,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c0a7c58 >2013-12-09 08:39:18,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43ae7472 >2013-12-09 08:39:18,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43ae7472 >2013-12-09 08:39:23,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a6f97a1 >2013-12-09 08:39:23,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: a6f97a1 >2013-12-09 08:39:23,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24c668fd >2013-12-09 08:39:24,136 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) No up server in cluster >2013-12-09 08:39:24,136 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:39:24,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 145b40ca >2013-12-09 08:39:24,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24c668fd >2013-12-09 08:39:24,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterTasksListVDSCommand, return: [], log id: 145b40ca >2013-12-09 08:39:29,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 473c8b7d >2013-12-09 08:39:29,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 473c8b7d >2013-12-09 08:39:29,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35423a71 >2013-12-09 08:39:29,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35423a71 >2013-12-09 08:39:35,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e33d660 >2013-12-09 08:39:35,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6e33d660 >2013-12-09 08:39:35,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e389b2 >2013-12-09 08:39:35,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e389b2 >2013-12-09 08:39:40,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70f2b56b >2013-12-09 08:39:41,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 70f2b56b >2013-12-09 08:39:41,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 22f49c9d >2013-12-09 08:39:41,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22f49c9d >2013-12-09 08:39:46,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 495d0024 >2013-12-09 08:39:47,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 495d0024 >2013-12-09 08:39:47,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c9c1295 >2013-12-09 08:39:47,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c9c1295 >2013-12-09 08:39:52,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a9f7bbb >2013-12-09 08:39:52,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4a9f7bbb >2013-12-09 08:39:52,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6673071f >2013-12-09 08:39:53,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6673071f >2013-12-09 08:39:58,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19e3ea60 >2013-12-09 08:39:58,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19e3ea60 >2013-12-09 08:39:58,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36ea0fa8 >2013-12-09 08:39:58,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36ea0fa8 >2013-12-09 08:40:03,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b7b2729 >2013-12-09 08:40:04,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4b7b2729 >2013-12-09 08:40:04,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c78a211 >2013-12-09 08:40:04,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c78a211 >2013-12-09 08:40:09,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 15261894 >2013-12-09 08:40:10,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 15261894 >2013-12-09 08:40:10,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 136c38e3 >2013-12-09 08:40:10,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 136c38e3 >2013-12-09 08:40:15,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18c741e7 >2013-12-09 08:40:16,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 18c741e7 >2013-12-09 08:40:16,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 411b6de1 >2013-12-09 08:40:16,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 411b6de1 >2013-12-09 08:40:21,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5dda32a1 >2013-12-09 08:40:21,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5dda32a1 >2013-12-09 08:40:21,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75cf21c >2013-12-09 08:40:22,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75cf21c >2013-12-09 08:40:24,406 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-56) No up server in cluster >2013-12-09 08:40:24,406 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-56) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:40:24,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 173a35c4 >2013-12-09 08:40:24,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterTasksListVDSCommand, return: [], log id: 173a35c4 >2013-12-09 08:40:27,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e4663b4 >2013-12-09 08:40:27,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e4663b4 >2013-12-09 08:40:27,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58290b30 >2013-12-09 08:40:27,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58290b30 >2013-12-09 08:40:32,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51828f5d >2013-12-09 08:40:33,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 51828f5d >2013-12-09 08:40:33,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6065640f >2013-12-09 08:40:33,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6065640f >2013-12-09 08:40:38,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33c8039f >2013-12-09 08:40:39,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 33c8039f >2013-12-09 08:40:39,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e2d15c5 >2013-12-09 08:40:39,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e2d15c5 >2013-12-09 08:40:44,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38f957c7 >2013-12-09 08:40:44,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 38f957c7 >2013-12-09 08:40:44,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38097709 >2013-12-09 08:40:45,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38097709 >2013-12-09 08:40:50,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2eb50097 >2013-12-09 08:40:50,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2eb50097 >2013-12-09 08:40:50,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1dd7a972 >2013-12-09 08:40:50,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1dd7a972 >2013-12-09 08:40:55,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72329653 >2013-12-09 08:40:56,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 72329653 >2013-12-09 08:40:56,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7079df5f >2013-12-09 08:40:56,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7079df5f >2013-12-09 08:41:01,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47797a72 >2013-12-09 08:41:02,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 47797a72 >2013-12-09 08:41:02,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 174a222c >2013-12-09 08:41:02,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 174a222c >2013-12-09 08:41:07,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 337fcf5f >2013-12-09 08:41:08,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 337fcf5f >2013-12-09 08:41:08,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7cc86001 >2013-12-09 08:41:08,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7cc86001 >2013-12-09 08:41:13,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e7e0300 >2013-12-09 08:41:13,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2e7e0300 >2013-12-09 08:41:13,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b67a0ce >2013-12-09 08:41:14,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b67a0ce >2013-12-09 08:41:19,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e36ae7b >2013-12-09 08:41:19,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3e36ae7b >2013-12-09 08:41:19,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f1ef55c >2013-12-09 08:41:19,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f1ef55c >2013-12-09 08:41:24,687 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-44) No up server in cluster >2013-12-09 08:41:24,688 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-44) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:41:24,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d34291c >2013-12-09 08:41:24,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6cbe48 >2013-12-09 08:41:24,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterTasksListVDSCommand, return: [], log id: d34291c >2013-12-09 08:41:25,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6cbe48 >2013-12-09 08:41:25,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 515b7c05 >2013-12-09 08:41:25,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 515b7c05 >2013-12-09 08:41:30,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 388e70e2 >2013-12-09 08:41:31,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 388e70e2 >2013-12-09 08:41:31,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50406153 >2013-12-09 08:41:31,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50406153 >2013-12-09 08:41:36,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55bfc23c >2013-12-09 08:41:36,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 55bfc23c >2013-12-09 08:41:36,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 377d7987 >2013-12-09 08:41:37,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 377d7987 >2013-12-09 08:41:42,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 302aa415 >2013-12-09 08:41:42,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 302aa415 >2013-12-09 08:41:42,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7939a14d >2013-12-09 08:41:43,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7939a14d >2013-12-09 08:41:48,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18fe7a58 >2013-12-09 08:41:48,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 18fe7a58 >2013-12-09 08:41:48,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b83ddda >2013-12-09 08:41:48,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b83ddda >2013-12-09 08:41:53,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b279f8e >2013-12-09 08:41:54,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b279f8e >2013-12-09 08:41:54,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e2aaa9a >2013-12-09 08:41:54,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e2aaa9a >2013-12-09 08:41:59,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67dc5084 >2013-12-09 08:42:00,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 67dc5084 >2013-12-09 08:42:00,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 86747fd >2013-12-09 08:42:00,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 86747fd >2013-12-09 08:42:05,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c9d645c >2013-12-09 08:42:05,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c9d645c >2013-12-09 08:42:05,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78809eab >2013-12-09 08:42:06,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78809eab >2013-12-09 08:42:11,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2343025e >2013-12-09 08:42:11,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2343025e >2013-12-09 08:42:11,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e5ea983 >2013-12-09 08:42:11,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e5ea983 >2013-12-09 08:42:16,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4877585c >2013-12-09 08:42:17,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4877585c >2013-12-09 08:42:17,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bf2d32a >2013-12-09 08:42:17,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4bf2d32a >2013-12-09 08:42:22,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5fe8bc90 >2013-12-09 08:42:23,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5fe8bc90 >2013-12-09 08:42:23,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11d83c09 >2013-12-09 08:42:23,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11d83c09 >2013-12-09 08:42:24,971 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-71) No up server in cluster >2013-12-09 08:42:24,971 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-71) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:42:24,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 260e3745 >2013-12-09 08:42:25,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterTasksListVDSCommand, return: [], log id: 260e3745 >2013-12-09 08:42:28,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4727d176 >2013-12-09 08:42:28,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4727d176 >2013-12-09 08:42:28,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 525a0aa2 >2013-12-09 08:42:29,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 525a0aa2 >2013-12-09 08:42:34,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5437b0e6 >2013-12-09 08:42:34,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5437b0e6 >2013-12-09 08:42:34,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f937dd3 >2013-12-09 08:42:34,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f937dd3 >2013-12-09 08:42:40,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a5c8c74 >2013-12-09 08:42:40,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: a5c8c74 >2013-12-09 08:42:40,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ceeec5d >2013-12-09 08:42:40,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ceeec5d >2013-12-09 08:42:45,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2749a476 >2013-12-09 08:42:46,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2749a476 >2013-12-09 08:42:46,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35c82396 >2013-12-09 08:42:46,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35c82396 >2013-12-09 08:42:51,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4808e76a >2013-12-09 08:42:52,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4808e76a >2013-12-09 08:42:52,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6be82aa5 >2013-12-09 08:42:52,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6be82aa5 >2013-12-09 08:42:57,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b453600 >2013-12-09 08:42:57,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3b453600 >2013-12-09 08:42:57,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 380f88df >2013-12-09 08:42:58,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 380f88df >2013-12-09 08:43:03,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65d80304 >2013-12-09 08:43:03,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 65d80304 >2013-12-09 08:43:03,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bc64b32 >2013-12-09 08:43:03,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bc64b32 >2013-12-09 08:43:08,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29d495e2 >2013-12-09 08:43:09,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 29d495e2 >2013-12-09 08:43:09,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75542619 >2013-12-09 08:43:09,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75542619 >2013-12-09 08:43:14,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ad7686a >2013-12-09 08:43:15,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5ad7686a >2013-12-09 08:43:15,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7122fe1b >2013-12-09 08:43:15,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7122fe1b >2013-12-09 08:43:20,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b1224ce >2013-12-09 08:43:21,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b1224ce >2013-12-09 08:43:21,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b4258df >2013-12-09 08:43:21,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b4258df >2013-12-09 08:43:25,260 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-80) No up server in cluster >2013-12-09 08:43:25,260 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-80) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:43:25,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d780fdc >2013-12-09 08:43:25,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterTasksListVDSCommand, return: [], log id: d780fdc >2013-12-09 08:43:26,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35f0d3e6 >2013-12-09 08:43:26,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 35f0d3e6 >2013-12-09 08:43:26,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5882578d >2013-12-09 08:43:27,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5882578d >2013-12-09 08:43:32,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5111d4c4 >2013-12-09 08:43:32,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5111d4c4 >2013-12-09 08:43:32,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f068454 >2013-12-09 08:43:32,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f068454 >2013-12-09 08:43:37,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63983e60 >2013-12-09 08:43:38,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 63983e60 >2013-12-09 08:43:38,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67475b33 >2013-12-09 08:43:38,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67475b33 >2013-12-09 08:43:43,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 300cd949 >2013-12-09 08:43:44,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 300cd949 >2013-12-09 08:43:44,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54ec332d >2013-12-09 08:43:44,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54ec332d >2013-12-09 08:43:49,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 438abebf >2013-12-09 08:43:49,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 438abebf >2013-12-09 08:43:49,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ced428c >2013-12-09 08:43:50,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ced428c >2013-12-09 08:43:55,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23fd003c >2013-12-09 08:43:55,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 23fd003c >2013-12-09 08:43:55,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 474bdf74 >2013-12-09 08:43:55,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 474bdf74 >2013-12-09 08:44:00,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d2b58e >2013-12-09 08:44:01,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d2b58e >2013-12-09 08:44:01,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45c19e99 >2013-12-09 08:44:01,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45c19e99 >2013-12-09 08:44:06,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b3aa51b >2013-12-09 08:44:07,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b3aa51b >2013-12-09 08:44:07,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f77eac >2013-12-09 08:44:07,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f77eac >2013-12-09 08:44:12,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2045861c >2013-12-09 08:44:13,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2045861c >2013-12-09 08:44:13,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 571bc343 >2013-12-09 08:44:13,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 571bc343 >2013-12-09 08:44:18,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d012ef2 >2013-12-09 08:44:18,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6d012ef2 >2013-12-09 08:44:18,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4501ad9d >2013-12-09 08:44:19,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4501ad9d >2013-12-09 08:44:24,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a05dd3c >2013-12-09 08:44:24,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7a05dd3c >2013-12-09 08:44:24,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d92e0a5 >2013-12-09 08:44:24,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d92e0a5 >2013-12-09 08:44:25,548 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-94) No up server in cluster >2013-12-09 08:44:25,548 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-94) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:44:25,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 430b5468 >2013-12-09 08:44:25,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterTasksListVDSCommand, return: [], log id: 430b5468 >2013-12-09 08:44:29,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1758 >2013-12-09 08:44:30,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1758 >2013-12-09 08:44:30,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5cc47b49 >2013-12-09 08:44:30,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cc47b49 >2013-12-09 08:44:35,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4dc81fab >2013-12-09 08:44:36,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4dc81fab >2013-12-09 08:44:36,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14efeae6 >2013-12-09 08:44:36,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14efeae6 >2013-12-09 08:44:41,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7057dfc8 >2013-12-09 08:44:41,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7057dfc8 >2013-12-09 08:44:41,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16cce6d2 >2013-12-09 08:44:42,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16cce6d2 >2013-12-09 08:44:47,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 530ef0c9 >2013-12-09 08:44:47,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 530ef0c9 >2013-12-09 08:44:47,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59153165 >2013-12-09 08:44:47,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59153165 >2013-12-09 08:44:53,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59723512 >2013-12-09 08:44:53,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 59723512 >2013-12-09 08:44:53,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e8feeab >2013-12-09 08:44:53,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e8feeab >2013-12-09 08:44:58,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63e07a1a >2013-12-09 08:44:59,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 63e07a1a >2013-12-09 08:44:59,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36e17f99 >2013-12-09 08:44:59,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36e17f99 >2013-12-09 08:45:04,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 799e41a7 >2013-12-09 08:45:05,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 799e41a7 >2013-12-09 08:45:05,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e4224e >2013-12-09 08:45:05,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e4224e >2013-12-09 08:45:10,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e56dac8 >2013-12-09 08:45:10,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4e56dac8 >2013-12-09 08:45:10,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f19971a >2013-12-09 08:45:11,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f19971a >2013-12-09 08:45:16,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: de73b7 >2013-12-09 08:45:16,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: de73b7 >2013-12-09 08:45:16,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6fc396aa >2013-12-09 08:45:16,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6fc396aa >2013-12-09 08:45:21,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 24f240d7 >2013-12-09 08:45:22,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 24f240d7 >2013-12-09 08:45:22,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3256c94 >2013-12-09 08:45:22,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3256c94 >2013-12-09 08:45:25,834 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-32) No up server in cluster >2013-12-09 08:45:25,834 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-32) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:45:25,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68c0c3a8 >2013-12-09 08:45:26,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterTasksListVDSCommand, return: [], log id: 68c0c3a8 >2013-12-09 08:45:27,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21d22e7a >2013-12-09 08:45:28,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 21d22e7a >2013-12-09 08:45:28,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10b6a056 >2013-12-09 08:45:28,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10b6a056 >2013-12-09 08:45:33,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1376d16a >2013-12-09 08:45:33,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1376d16a >2013-12-09 08:45:33,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 361c0c76 >2013-12-09 08:45:34,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 361c0c76 >2013-12-09 08:45:39,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ff4fe93 >2013-12-09 08:45:39,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6ff4fe93 >2013-12-09 08:45:39,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6aeead5d >2013-12-09 08:45:39,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6aeead5d >2013-12-09 08:45:44,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bab2e08 >2013-12-09 08:45:45,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2bab2e08 >2013-12-09 08:45:45,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d2611fe >2013-12-09 08:45:45,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d2611fe >2013-12-09 08:45:50,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4440e22e >2013-12-09 08:45:51,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4440e22e >2013-12-09 08:45:51,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78d83794 >2013-12-09 08:45:51,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78d83794 >2013-12-09 08:45:56,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45986654 >2013-12-09 08:45:56,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 45986654 >2013-12-09 08:45:56,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b00715 >2013-12-09 08:45:57,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b00715 >2013-12-09 08:46:02,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5de4160b >2013-12-09 08:46:02,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5de4160b >2013-12-09 08:46:02,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61c12931 >2013-12-09 08:46:03,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61c12931 >2013-12-09 08:46:08,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42da3ee3 >2013-12-09 08:46:08,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42da3ee3 >2013-12-09 08:46:08,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1189069e >2013-12-09 08:46:08,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1189069e >2013-12-09 08:46:13,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 190f95f2 >2013-12-09 08:46:14,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 190f95f2 >2013-12-09 08:46:14,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5420f627 >2013-12-09 08:46:14,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5420f627 >2013-12-09 08:46:19,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 15ec1f36 >2013-12-09 08:46:20,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 15ec1f36 >2013-12-09 08:46:20,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c28581c >2013-12-09 08:46:20,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c28581c >2013-12-09 08:46:25,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1166fa43 >2013-12-09 08:46:25,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1166fa43 >2013-12-09 08:46:25,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60125b57 >2013-12-09 08:46:26,105 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-70) No up server in cluster >2013-12-09 08:46:26,105 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-70) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:46:26,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58e6207a >2013-12-09 08:46:26,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60125b57 >2013-12-09 08:46:26,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterTasksListVDSCommand, return: [], log id: 58e6207a >2013-12-09 08:46:31,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ee78194 >2013-12-09 08:46:31,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ee78194 >2013-12-09 08:46:31,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 555b1da3 >2013-12-09 08:46:31,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 555b1da3 >2013-12-09 08:46:36,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79a37560 >2013-12-09 08:46:37,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 79a37560 >2013-12-09 08:46:37,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6731a284 >2013-12-09 08:46:37,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6731a284 >2013-12-09 08:46:42,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4700e254 >2013-12-09 08:46:43,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4700e254 >2013-12-09 08:46:43,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2afb3133 >2013-12-09 08:46:43,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2afb3133 >2013-12-09 08:46:48,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72ca60a >2013-12-09 08:46:49,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 72ca60a >2013-12-09 08:46:49,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6622ccd1 >2013-12-09 08:46:49,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6622ccd1 >2013-12-09 08:46:54,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 14f6fa19 >2013-12-09 08:46:54,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 14f6fa19 >2013-12-09 08:46:54,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c9571c3 >2013-12-09 08:46:55,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c9571c3 >2013-12-09 08:47:00,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a0e7c35 >2013-12-09 08:47:00,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2a0e7c35 >2013-12-09 08:47:00,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e2a8109 >2013-12-09 08:47:00,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e2a8109 >2013-12-09 08:47:05,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 686d2e >2013-12-09 08:47:06,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 686d2e >2013-12-09 08:47:06,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e996b4f >2013-12-09 08:47:06,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e996b4f >2013-12-09 08:47:11,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3fb460f7 >2013-12-09 08:47:12,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3fb460f7 >2013-12-09 08:47:12,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a2117aa >2013-12-09 08:47:12,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a2117aa >2013-12-09 08:47:17,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4707891d >2013-12-09 08:47:17,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4707891d >2013-12-09 08:47:17,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f60b73d >2013-12-09 08:47:18,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f60b73d >2013-12-09 08:47:23,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d7d0557 >2013-12-09 08:47:23,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d7d0557 >2013-12-09 08:47:23,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29f07bd8 >2013-12-09 08:47:23,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29f07bd8 >2013-12-09 08:47:26,365 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-23) No up server in cluster >2013-12-09 08:47:26,366 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-23) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:47:26,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3812fdc9 >2013-12-09 08:47:26,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3812fdc9 >2013-12-09 08:47:28,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f078094 >2013-12-09 08:47:29,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f078094 >2013-12-09 08:47:29,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 571aef7b >2013-12-09 08:47:29,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 571aef7b >2013-12-09 08:47:34,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 245fec0a >2013-12-09 08:47:35,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 245fec0a >2013-12-09 08:47:35,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 24e9abe7 >2013-12-09 08:47:35,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24e9abe7 >2013-12-09 08:47:40,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 690b41d7 >2013-12-09 08:47:41,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 690b41d7 >2013-12-09 08:47:41,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46553ad5 >2013-12-09 08:47:41,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46553ad5 >2013-12-09 08:47:46,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67994977 >2013-12-09 08:47:46,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 67994977 >2013-12-09 08:47:46,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 505236f9 >2013-12-09 08:47:47,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 505236f9 >2013-12-09 08:47:52,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f7911b8 >2013-12-09 08:47:52,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f7911b8 >2013-12-09 08:47:52,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18e51812 >2013-12-09 08:47:52,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18e51812 >2013-12-09 08:47:57,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f91a1c0 >2013-12-09 08:47:58,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6f91a1c0 >2013-12-09 08:47:58,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b695209 >2013-12-09 08:47:58,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b695209 >2013-12-09 08:48:03,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d8ea823 >2013-12-09 08:48:04,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5d8ea823 >2013-12-09 08:48:04,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c5f7599 >2013-12-09 08:48:04,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c5f7599 >2013-12-09 08:48:09,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 609bbfd1 >2013-12-09 08:48:09,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 609bbfd1 >2013-12-09 08:48:09,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61088cfe >2013-12-09 08:48:10,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61088cfe >2013-12-09 08:48:15,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1fc7d88c >2013-12-09 08:48:15,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1fc7d88c >2013-12-09 08:48:15,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19e2d68d >2013-12-09 08:48:15,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19e2d68d >2013-12-09 08:48:20,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4448ef5 >2013-12-09 08:48:21,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4448ef5 >2013-12-09 08:48:21,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56cc0894 >2013-12-09 08:48:21,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56cc0894 >2013-12-09 08:48:26,652 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-48) No up server in cluster >2013-12-09 08:48:26,652 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-48) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:48:26,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b802483 >2013-12-09 08:48:26,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67f8967f >2013-12-09 08:48:26,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7b802483 >2013-12-09 08:48:27,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 67f8967f >2013-12-09 08:48:27,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f0fb1c3 >2013-12-09 08:48:27,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f0fb1c3 >2013-12-09 08:48:32,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13163d95 >2013-12-09 08:48:32,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 13163d95 >2013-12-09 08:48:32,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ef1fc34 >2013-12-09 08:48:33,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ef1fc34 >2013-12-09 08:48:38,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fc3f107 >2013-12-09 08:48:38,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7fc3f107 >2013-12-09 08:48:38,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e9b7c88 >2013-12-09 08:48:38,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e9b7c88 >2013-12-09 08:48:43,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72237379 >2013-12-09 08:48:44,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 72237379 >2013-12-09 08:48:44,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12af9273 >2013-12-09 08:48:44,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12af9273 >2013-12-09 08:48:49,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4de7199b >2013-12-09 08:48:50,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4de7199b >2013-12-09 08:48:50,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1639ed2b >2013-12-09 08:48:50,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1639ed2b >2013-12-09 08:48:55,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1cdd83d7 >2013-12-09 08:48:55,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1cdd83d7 >2013-12-09 08:48:55,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2666f106 >2013-12-09 08:48:56,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2666f106 >2013-12-09 08:49:01,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51044412 >2013-12-09 08:49:01,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 51044412 >2013-12-09 08:49:01,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2eae20c9 >2013-12-09 08:49:01,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2eae20c9 >2013-12-09 08:49:06,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a3de114 >2013-12-09 08:49:07,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4a3de114 >2013-12-09 08:49:07,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b8c62a2 >2013-12-09 08:49:07,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b8c62a2 >2013-12-09 08:49:12,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 524ba4cb >2013-12-09 08:49:13,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 524ba4cb >2013-12-09 08:49:13,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b4b83f3 >2013-12-09 08:49:13,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b4b83f3 >2013-12-09 08:49:18,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e1d9bfc >2013-12-09 08:49:18,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1e1d9bfc >2013-12-09 08:49:18,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32edf8c3 >2013-12-09 08:49:19,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32edf8c3 >2013-12-09 08:49:24,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e5391f9 >2013-12-09 08:49:24,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e5391f9 >2013-12-09 08:49:24,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ef4459f >2013-12-09 08:49:24,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ef4459f >2013-12-09 08:49:26,833 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-79) No up server in cluster >2013-12-09 08:49:26,833 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-79) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:49:26,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55a7ce9a >2013-12-09 08:49:27,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterTasksListVDSCommand, return: [], log id: 55a7ce9a >2013-12-09 08:49:29,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51494cb5 >2013-12-09 08:49:30,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 51494cb5 >2013-12-09 08:49:30,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ec77b8b >2013-12-09 08:49:30,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ec77b8b >2013-12-09 08:49:35,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70c6733a >2013-12-09 08:49:36,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 70c6733a >2013-12-09 08:49:36,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 360e91a0 >2013-12-09 08:49:36,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 360e91a0 >2013-12-09 08:49:41,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61e2c5e2 >2013-12-09 08:49:42,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 61e2c5e2 >2013-12-09 08:49:42,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 425f146a >2013-12-09 08:49:42,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 425f146a >2013-12-09 08:49:47,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c569c65 >2013-12-09 08:49:47,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1c569c65 >2013-12-09 08:49:47,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5099f5c8 >2013-12-09 08:49:48,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5099f5c8 >2013-12-09 08:49:53,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51b08ff7 >2013-12-09 08:49:53,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 51b08ff7 >2013-12-09 08:49:53,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2bf1fc1a >2013-12-09 08:49:53,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bf1fc1a >2013-12-09 08:49:58,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 563bd94a >2013-12-09 08:49:59,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 563bd94a >2013-12-09 08:49:59,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5eaaa1eb >2013-12-09 08:49:59,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5eaaa1eb >2013-12-09 08:50:04,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c083f2c >2013-12-09 08:50:05,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1c083f2c >2013-12-09 08:50:05,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c5edfed >2013-12-09 08:50:05,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c5edfed >2013-12-09 08:50:10,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c367671 >2013-12-09 08:50:10,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c367671 >2013-12-09 08:50:10,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d158122 >2013-12-09 08:50:11,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d158122 >2013-12-09 08:50:16,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b6623b4 >2013-12-09 08:50:16,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: b6623b4 >2013-12-09 08:50:16,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c3f1d95 >2013-12-09 08:50:17,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c3f1d95 >2013-12-09 08:50:22,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 739750e0 >2013-12-09 08:50:22,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 739750e0 >2013-12-09 08:50:22,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d519e52 >2013-12-09 08:50:22,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d519e52 >2013-12-09 08:50:27,104 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-67) No up server in cluster >2013-12-09 08:50:27,104 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-67) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:50:27,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66094dea >2013-12-09 08:50:27,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterTasksListVDSCommand, return: [], log id: 66094dea >2013-12-09 08:50:27,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ed7e0b1 >2013-12-09 08:50:28,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ed7e0b1 >2013-12-09 08:50:28,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 399292d6 >2013-12-09 08:50:28,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 399292d6 >2013-12-09 08:50:33,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4fe1c21 >2013-12-09 08:50:34,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4fe1c21 >2013-12-09 08:50:34,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59ad9dd2 >2013-12-09 08:50:34,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59ad9dd2 >2013-12-09 08:50:39,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43197c7d >2013-12-09 08:50:39,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 43197c7d >2013-12-09 08:50:39,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c6416c5 >2013-12-09 08:50:40,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c6416c5 >2013-12-09 08:50:45,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 434a98ad >2013-12-09 08:50:45,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 434a98ad >2013-12-09 08:50:45,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 608c33d0 >2013-12-09 08:50:45,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 608c33d0 >2013-12-09 08:50:50,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75b4c3c1 >2013-12-09 08:50:51,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 75b4c3c1 >2013-12-09 08:50:51,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4716c69a >2013-12-09 08:50:51,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4716c69a >2013-12-09 08:50:56,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 15c32e07 >2013-12-09 08:50:57,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 15c32e07 >2013-12-09 08:50:57,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a404bb3 >2013-12-09 08:50:57,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a404bb3 >2013-12-09 08:51:02,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60018253 >2013-12-09 08:51:02,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 60018253 >2013-12-09 08:51:02,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32451ec2 >2013-12-09 08:51:03,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32451ec2 >2013-12-09 08:51:08,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35db3f5 >2013-12-09 08:51:08,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 35db3f5 >2013-12-09 08:51:08,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c76b450 >2013-12-09 08:51:08,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c76b450 >2013-12-09 08:51:14,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f4a7fff >2013-12-09 08:51:14,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f4a7fff >2013-12-09 08:51:14,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 310ebd1e >2013-12-09 08:51:14,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 310ebd1e >2013-12-09 08:51:19,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fd0ec83 >2013-12-09 08:51:20,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7fd0ec83 >2013-12-09 08:51:20,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2aaf81d2 >2013-12-09 08:51:20,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2aaf81d2 >2013-12-09 08:51:25,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f78f50 >2013-12-09 08:51:26,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7f78f50 >2013-12-09 08:51:26,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a65b7c0 >2013-12-09 08:51:26,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a65b7c0 >2013-12-09 08:51:27,372 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) No up server in cluster >2013-12-09 08:51:27,373 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:51:27,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 722c748 >2013-12-09 08:51:27,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterTasksListVDSCommand, return: [], log id: 722c748 >2013-12-09 08:51:31,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c5b1153 >2013-12-09 08:51:31,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1c5b1153 >2013-12-09 08:51:31,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c5681b4 >2013-12-09 08:51:32,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c5681b4 >2013-12-09 08:51:37,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 473791b8 >2013-12-09 08:51:37,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 473791b8 >2013-12-09 08:51:37,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e6e9f68 >2013-12-09 08:51:37,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e6e9f68 >2013-12-09 08:51:42,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: faec898 >2013-12-09 08:51:43,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: faec898 >2013-12-09 08:51:43,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2abd4cad >2013-12-09 08:51:43,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2abd4cad >2013-12-09 08:51:48,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16a4ff09 >2013-12-09 08:51:49,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 16a4ff09 >2013-12-09 08:51:49,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 98b42f9 >2013-12-09 08:51:49,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 98b42f9 >2013-12-09 08:51:54,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f9e8c78 >2013-12-09 08:51:54,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3f9e8c78 >2013-12-09 08:51:54,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d390bf7 >2013-12-09 08:51:55,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d390bf7 >2013-12-09 08:52:00,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24a53d0a >2013-12-09 08:52:00,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 24a53d0a >2013-12-09 08:52:00,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d5017b2 >2013-12-09 08:52:01,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d5017b2 >2013-12-09 08:52:06,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f014875 >2013-12-09 08:52:06,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: f014875 >2013-12-09 08:52:06,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d82e0e4 >2013-12-09 08:52:06,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d82e0e4 >2013-12-09 08:52:11,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: adc705a >2013-12-09 08:52:12,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: adc705a >2013-12-09 08:52:12,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b28346d >2013-12-09 08:52:12,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b28346d >2013-12-09 08:52:17,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71f4b9f7 >2013-12-09 08:52:18,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 71f4b9f7 >2013-12-09 08:52:18,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 232378ec >2013-12-09 08:52:18,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 232378ec >2013-12-09 08:52:23,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3875be7a >2013-12-09 08:52:23,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3875be7a >2013-12-09 08:52:23,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43520289 >2013-12-09 08:52:24,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43520289 >2013-12-09 08:52:27,659 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-98) No up server in cluster >2013-12-09 08:52:27,660 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-98) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:52:27,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d1a1625 >2013-12-09 08:52:27,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterTasksListVDSCommand, return: [], log id: d1a1625 >2013-12-09 08:52:29,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6dfb2e32 >2013-12-09 08:52:29,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6dfb2e32 >2013-12-09 08:52:29,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61901947 >2013-12-09 08:52:29,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61901947 >2013-12-09 08:52:34,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7307145a >2013-12-09 08:52:35,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7307145a >2013-12-09 08:52:35,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f94f5e2 >2013-12-09 08:52:35,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f94f5e2 >2013-12-09 08:52:40,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4bf2e3e >2013-12-09 08:52:41,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4bf2e3e >2013-12-09 08:52:41,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6061b2bf >2013-12-09 08:52:41,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6061b2bf >2013-12-09 08:52:46,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51236f4 >2013-12-09 08:52:46,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 51236f4 >2013-12-09 08:52:46,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7463c5fc >2013-12-09 08:52:47,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7463c5fc >2013-12-09 08:52:52,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 566b850d >2013-12-09 08:52:52,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 566b850d >2013-12-09 08:52:52,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4485eb45 >2013-12-09 08:52:53,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4485eb45 >2013-12-09 08:52:58,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 181b7381 >2013-12-09 08:52:58,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 181b7381 >2013-12-09 08:52:58,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a3c2b2a >2013-12-09 08:52:58,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a3c2b2a >2013-12-09 08:53:03,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a8487c0 >2013-12-09 08:53:04,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a8487c0 >2013-12-09 08:53:04,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 579707cd >2013-12-09 08:53:04,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 579707cd >2013-12-09 08:53:09,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ccfd34e >2013-12-09 08:53:10,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1ccfd34e >2013-12-09 08:53:10,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24b5e827 >2013-12-09 08:53:10,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24b5e827 >2013-12-09 08:53:15,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2cec03cf >2013-12-09 08:53:15,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2cec03cf >2013-12-09 08:53:15,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 109b72b2 >2013-12-09 08:53:16,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 109b72b2 >2013-12-09 08:53:21,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ea3bf69 >2013-12-09 08:53:21,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7ea3bf69 >2013-12-09 08:53:21,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24599cc6 >2013-12-09 08:53:21,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24599cc6 >2013-12-09 08:53:26,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11265d01 >2013-12-09 08:53:27,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 11265d01 >2013-12-09 08:53:27,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5da9a17e >2013-12-09 08:53:27,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5da9a17e >2013-12-09 08:53:27,958 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) No up server in cluster >2013-12-09 08:53:27,958 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:53:27,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 658ee78 >2013-12-09 08:53:28,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterTasksListVDSCommand, return: [], log id: 658ee78 >2013-12-09 08:53:32,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 559e76e7 >2013-12-09 08:53:33,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 559e76e7 >2013-12-09 08:53:33,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 178867ef >2013-12-09 08:53:33,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 178867ef >2013-12-09 08:53:38,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69bf6156 >2013-12-09 08:53:38,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 69bf6156 >2013-12-09 08:53:39,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4050c1f >2013-12-09 08:53:39,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4050c1f >2013-12-09 08:53:44,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12c71993 >2013-12-09 08:53:44,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 12c71993 >2013-12-09 08:53:44,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39ebb9b1 >2013-12-09 08:53:45,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39ebb9b1 >2013-12-09 08:53:50,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a24eeae >2013-12-09 08:53:50,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1a24eeae >2013-12-09 08:53:50,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3bea5b6f >2013-12-09 08:53:50,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3bea5b6f >2013-12-09 08:53:55,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58aa130 >2013-12-09 08:53:56,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 58aa130 >2013-12-09 08:53:56,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d253718 >2013-12-09 08:53:56,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d253718 >2013-12-09 08:54:01,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 156a7222 >2013-12-09 08:54:02,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 156a7222 >2013-12-09 08:54:02,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e62878d >2013-12-09 08:54:02,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e62878d >2013-12-09 08:54:07,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c45c90e >2013-12-09 08:54:07,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c45c90e >2013-12-09 08:54:07,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b41cfb8 >2013-12-09 08:54:08,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b41cfb8 >2013-12-09 08:54:13,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 24136362 >2013-12-09 08:54:13,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 24136362 >2013-12-09 08:54:13,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e2aced >2013-12-09 08:54:13,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e2aced >2013-12-09 08:54:18,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7eb58237 >2013-12-09 08:54:19,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7eb58237 >2013-12-09 08:54:19,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70a56efe >2013-12-09 08:54:19,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70a56efe >2013-12-09 08:54:24,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 870118e >2013-12-09 08:54:25,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 870118e >2013-12-09 08:54:25,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63382124 >2013-12-09 08:54:25,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63382124 >2013-12-09 08:54:28,261 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-74) No up server in cluster >2013-12-09 08:54:28,261 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-74) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:54:28,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14c912b8 >2013-12-09 08:54:28,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterTasksListVDSCommand, return: [], log id: 14c912b8 >2013-12-09 08:54:30,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 193db45a >2013-12-09 08:54:31,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 193db45a >2013-12-09 08:54:31,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a05ca6 >2013-12-09 08:54:31,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a05ca6 >2013-12-09 08:54:36,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23e9ed05 >2013-12-09 08:54:36,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 23e9ed05 >2013-12-09 08:54:36,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40d5ddc8 >2013-12-09 08:54:37,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40d5ddc8 >2013-12-09 08:54:42,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6665789f >2013-12-09 08:54:42,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6665789f >2013-12-09 08:54:42,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70f94f6a >2013-12-09 08:54:42,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70f94f6a >2013-12-09 08:54:47,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65dd619 >2013-12-09 08:54:48,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 65dd619 >2013-12-09 08:54:48,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e892f01 >2013-12-09 08:54:48,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e892f01 >2013-12-09 08:54:53,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f739115 >2013-12-09 08:54:54,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3f739115 >2013-12-09 08:54:54,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53c9b666 >2013-12-09 08:54:54,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53c9b666 >2013-12-09 08:54:59,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 288890d5 >2013-12-09 08:54:59,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 288890d5 >2013-12-09 08:54:59,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17e77498 >2013-12-09 08:55:00,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17e77498 >2013-12-09 08:55:05,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58eeeedd >2013-12-09 08:55:05,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 58eeeedd >2013-12-09 08:55:05,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f4d63aa >2013-12-09 08:55:05,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f4d63aa >2013-12-09 08:55:10,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 527eb81e >2013-12-09 08:55:11,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 527eb81e >2013-12-09 08:55:11,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d515d53 >2013-12-09 08:55:11,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d515d53 >2013-12-09 08:55:16,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a92ffec >2013-12-09 08:55:17,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: a92ffec >2013-12-09 08:55:17,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b48e09c >2013-12-09 08:55:17,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b48e09c >2013-12-09 08:55:22,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45b3235e >2013-12-09 08:55:23,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 45b3235e >2013-12-09 08:55:23,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d8318ef >2013-12-09 08:55:23,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d8318ef >2013-12-09 08:55:28,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e249154 >2013-12-09 08:55:28,527 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-50) No up server in cluster >2013-12-09 08:55:28,527 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-50) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:55:28,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d7bf2e7 >2013-12-09 08:55:28,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6d7bf2e7 >2013-12-09 08:55:28,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: e249154 >2013-12-09 08:55:28,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5cfccf80 >2013-12-09 08:55:29,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cfccf80 >2013-12-09 08:55:34,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ebbb7da >2013-12-09 08:55:34,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3ebbb7da >2013-12-09 08:55:34,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25a09c1e >2013-12-09 08:55:34,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25a09c1e >2013-12-09 08:55:39,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e26aca1 >2013-12-09 08:55:40,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6e26aca1 >2013-12-09 08:55:40,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 314ed911 >2013-12-09 08:55:40,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 314ed911 >2013-12-09 08:55:45,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73106453 >2013-12-09 08:55:46,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 73106453 >2013-12-09 08:55:46,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2338271b >2013-12-09 08:55:46,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2338271b >2013-12-09 08:55:51,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ac31566 >2013-12-09 08:55:51,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ac31566 >2013-12-09 08:55:51,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e3c3209 >2013-12-09 08:55:52,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e3c3209 >2013-12-09 08:55:57,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f9ecd25 >2013-12-09 08:55:57,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f9ecd25 >2013-12-09 08:55:57,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78237073 >2013-12-09 08:55:57,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78237073 >2013-12-09 08:56:02,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19828aa6 >2013-12-09 08:56:03,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 19828aa6 >2013-12-09 08:56:03,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a9e58f1 >2013-12-09 08:56:03,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a9e58f1 >2013-12-09 08:56:08,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 259e34d >2013-12-09 08:56:09,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 259e34d >2013-12-09 08:56:09,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71d26ba >2013-12-09 08:56:09,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71d26ba >2013-12-09 08:56:14,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 495b2804 >2013-12-09 08:56:15,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 495b2804 >2013-12-09 08:56:15,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54baf609 >2013-12-09 08:56:15,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54baf609 >2013-12-09 08:56:20,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a6616b3 >2013-12-09 08:56:20,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1a6616b3 >2013-12-09 08:56:20,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61685ca1 >2013-12-09 08:56:21,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61685ca1 >2013-12-09 08:56:26,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 694081a8 >2013-12-09 08:56:26,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 694081a8 >2013-12-09 08:56:26,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2734db9b >2013-12-09 08:56:26,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2734db9b >2013-12-09 08:56:28,815 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-82) No up server in cluster >2013-12-09 08:56:28,816 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-82) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:56:28,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3bbabb86 >2013-12-09 08:56:29,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3bbabb86 >2013-12-09 08:56:31,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62fa598a >2013-12-09 08:56:32,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 62fa598a >2013-12-09 08:56:32,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a6ee2f7 >2013-12-09 08:56:32,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a6ee2f7 >2013-12-09 08:56:37,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3cbfea5c >2013-12-09 08:56:38,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3cbfea5c >2013-12-09 08:56:38,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2555bca2 >2013-12-09 08:56:38,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2555bca2 >2013-12-09 08:56:43,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40b57bb2 >2013-12-09 08:56:43,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 40b57bb2 >2013-12-09 08:56:43,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 508a03d >2013-12-09 08:56:44,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 508a03d >2013-12-09 08:56:49,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74912a94 >2013-12-09 08:56:49,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 74912a94 >2013-12-09 08:56:49,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d52636d >2013-12-09 08:56:49,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d52636d >2013-12-09 08:56:54,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c813542 >2013-12-09 08:56:55,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c813542 >2013-12-09 08:56:55,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ba8c2d8 >2013-12-09 08:56:55,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ba8c2d8 >2013-12-09 08:57:00,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ed4a37c >2013-12-09 08:57:01,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ed4a37c >2013-12-09 08:57:01,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f8ad074 >2013-12-09 08:57:01,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f8ad074 >2013-12-09 08:57:06,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10a4bf4c >2013-12-09 08:57:07,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 10a4bf4c >2013-12-09 08:57:07,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c93759 >2013-12-09 08:57:07,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c93759 >2013-12-09 08:57:12,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 331164e0 >2013-12-09 08:57:12,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 331164e0 >2013-12-09 08:57:12,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 110a7329 >2013-12-09 08:57:13,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 110a7329 >2013-12-09 08:57:18,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54595e00 >2013-12-09 08:57:18,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 54595e00 >2013-12-09 08:57:18,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b3070ba >2013-12-09 08:57:18,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b3070ba >2013-12-09 08:57:23,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c9a30f9 >2013-12-09 08:57:24,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7c9a30f9 >2013-12-09 08:57:24,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 761fa22b >2013-12-09 08:57:24,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 761fa22b >2013-12-09 08:57:29,107 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-62) No up server in cluster >2013-12-09 08:57:29,108 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-62) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:57:29,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d0a9b22 >2013-12-09 08:57:29,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1d0a9b22 >2013-12-09 08:57:29,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e84e5b1 >2013-12-09 08:57:30,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e84e5b1 >2013-12-09 08:57:30,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 25a3df59 >2013-12-09 08:57:30,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25a3df59 >2013-12-09 08:57:35,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50a2e066 >2013-12-09 08:57:35,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 50a2e066 >2013-12-09 08:57:35,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26acf4fd >2013-12-09 08:57:36,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26acf4fd >2013-12-09 08:57:41,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b339164 >2013-12-09 08:57:41,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1b339164 >2013-12-09 08:57:41,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3645173b >2013-12-09 08:57:41,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3645173b >2013-12-09 08:57:46,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3366aaf1 >2013-12-09 08:57:47,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3366aaf1 >2013-12-09 08:57:47,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 49fc7eae >2013-12-09 08:57:47,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49fc7eae >2013-12-09 08:57:52,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c4a927b >2013-12-09 08:57:53,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c4a927b >2013-12-09 08:57:53,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b092e7 >2013-12-09 08:57:53,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b092e7 >2013-12-09 08:57:58,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c048521 >2013-12-09 08:57:59,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c048521 >2013-12-09 08:57:59,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 737faca7 >2013-12-09 08:57:59,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 737faca7 >2013-12-09 08:58:04,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11f8823c >2013-12-09 08:58:04,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 11f8823c >2013-12-09 08:58:04,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38794b20 >2013-12-09 08:58:05,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38794b20 >2013-12-09 08:58:10,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b20e39f >2013-12-09 08:58:10,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b20e39f >2013-12-09 08:58:10,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37246202 >2013-12-09 08:58:10,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37246202 >2013-12-09 08:58:15,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 514218c8 >2013-12-09 08:58:16,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 514218c8 >2013-12-09 08:58:16,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d58269d >2013-12-09 08:58:16,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d58269d >2013-12-09 08:58:21,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f108e06 >2013-12-09 08:58:22,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f108e06 >2013-12-09 08:58:22,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 225405be >2013-12-09 08:58:22,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 225405be >2013-12-09 08:58:27,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4fc72267 >2013-12-09 08:58:27,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4fc72267 >2013-12-09 08:58:27,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50fc50c9 >2013-12-09 08:58:28,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50fc50c9 >2013-12-09 08:58:29,392 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-23) No up server in cluster >2013-12-09 08:58:29,392 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-23) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:58:29,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2230801b >2013-12-09 08:58:29,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2230801b >2013-12-09 08:58:33,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a65a192 >2013-12-09 08:58:33,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a65a192 >2013-12-09 08:58:33,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 130b76b2 >2013-12-09 08:58:33,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 130b76b2 >2013-12-09 08:58:38,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71e02a8 >2013-12-09 08:58:39,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 71e02a8 >2013-12-09 08:58:39,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 711af6e7 >2013-12-09 08:58:39,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 711af6e7 >2013-12-09 08:58:44,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 109f240a >2013-12-09 08:58:45,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 109f240a >2013-12-09 08:58:45,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a2b1f5e >2013-12-09 08:58:45,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a2b1f5e >2013-12-09 08:58:50,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32ba8773 >2013-12-09 08:58:51,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 32ba8773 >2013-12-09 08:58:51,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 164ef436 >2013-12-09 08:58:51,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 164ef436 >2013-12-09 08:58:56,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e9ae96b >2013-12-09 08:58:56,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e9ae96b >2013-12-09 08:58:56,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e371fd9 >2013-12-09 08:58:57,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e371fd9 >2013-12-09 08:59:02,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e5a7025 >2013-12-09 08:59:02,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e5a7025 >2013-12-09 08:59:02,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2dd94a6f >2013-12-09 08:59:02,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2dd94a6f >2013-12-09 08:59:07,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21a0e7d9 >2013-12-09 08:59:08,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 21a0e7d9 >2013-12-09 08:59:08,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6412c073 >2013-12-09 08:59:08,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6412c073 >2013-12-09 08:59:13,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5656735e >2013-12-09 08:59:14,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5656735e >2013-12-09 08:59:14,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3cb92c32 >2013-12-09 08:59:14,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3cb92c32 >2013-12-09 08:59:19,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72dea8c9 >2013-12-09 08:59:19,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 72dea8c9 >2013-12-09 08:59:19,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: be7d819 >2013-12-09 08:59:20,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: be7d819 >2013-12-09 08:59:25,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b0e7c96 >2013-12-09 08:59:25,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: b0e7c96 >2013-12-09 08:59:25,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 785cb754 >2013-12-09 08:59:25,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 785cb754 >2013-12-09 08:59:29,682 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-29) No up server in cluster >2013-12-09 08:59:29,682 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-29) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 08:59:29,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 344c692a >2013-12-09 08:59:29,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterTasksListVDSCommand, return: [], log id: 344c692a >2013-12-09 08:59:30,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62ed9f9d >2013-12-09 08:59:31,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 62ed9f9d >2013-12-09 08:59:31,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10032465 >2013-12-09 08:59:31,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10032465 >2013-12-09 08:59:36,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74cc01bc >2013-12-09 08:59:37,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 74cc01bc >2013-12-09 08:59:37,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ca7cd78 >2013-12-09 08:59:37,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ca7cd78 >2013-12-09 08:59:38,739 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) Attempting to update VMs/Templates Ovf. >2013-12-09 08:59:40,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-47) START, GlusterHooksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4aa57387 >2013-12-09 08:59:40,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-46) START, GlusterHooksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60b9de1d >2013-12-09 08:59:40,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-46) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@5dcc8097, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@f344f16c, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@4976c940, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@bb187115, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@cda4f060, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@381bee71, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@4e654dcb], log id: 60b9de1d >2013-12-09 08:59:40,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-47) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@9c4060ed, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@15d8bef, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@670212b2, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@feb85144, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@15b1950, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@30bfcfbf, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@b6363451], log id: 4aa57387 >2013-12-09 08:59:42,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7172ba50 >2013-12-09 08:59:42,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7172ba50 >2013-12-09 08:59:42,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20256671 >2013-12-09 08:59:43,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20256671 >2013-12-09 08:59:44,458 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-98) Start refreshing all users data >2013-12-09 08:59:48,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17d513a5 >2013-12-09 08:59:48,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 17d513a5 >2013-12-09 08:59:48,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e601eb2 >2013-12-09 08:59:49,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e601eb2 >2013-12-09 08:59:54,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d6058c8 >2013-12-09 08:59:54,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4d6058c8 >2013-12-09 08:59:54,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67d08cbd >2013-12-09 08:59:54,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67d08cbd >2013-12-09 08:59:59,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e21400f >2013-12-09 09:00:00,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2e21400f >2013-12-09 09:00:00,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b86c77e >2013-12-09 09:00:00,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b86c77e >2013-12-09 09:00:05,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 645d07b8 >2013-12-09 09:00:06,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 645d07b8 >2013-12-09 09:00:06,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7bc94a16 >2013-12-09 09:00:06,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7bc94a16 >2013-12-09 09:00:11,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ea3d19a >2013-12-09 09:00:11,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6ea3d19a >2013-12-09 09:00:11,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a9e85cc >2013-12-09 09:00:12,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a9e85cc >2013-12-09 09:00:17,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 244187a1 >2013-12-09 09:00:17,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 244187a1 >2013-12-09 09:00:17,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49dbb0b2 >2013-12-09 09:00:17,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49dbb0b2 >2013-12-09 09:00:22,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2084f836 >2013-12-09 09:00:23,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2084f836 >2013-12-09 09:00:23,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16dcca76 >2013-12-09 09:00:23,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16dcca76 >2013-12-09 09:00:28,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 267710bc >2013-12-09 09:00:29,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 267710bc >2013-12-09 09:00:29,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e76f3f3 >2013-12-09 09:00:29,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e76f3f3 >2013-12-09 09:00:29,967 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-80) No up server in cluster >2013-12-09 09:00:29,967 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-80) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:00:29,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 463f90cb >2013-12-09 09:00:30,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterTasksListVDSCommand, return: [], log id: 463f90cb >2013-12-09 09:00:34,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ea22341 >2013-12-09 09:00:34,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ea22341 >2013-12-09 09:00:34,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 397d348 >2013-12-09 09:00:35,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 397d348 >2013-12-09 09:00:40,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c01f725 >2013-12-09 09:00:40,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c01f725 >2013-12-09 09:00:40,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a0cb2cf >2013-12-09 09:00:41,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a0cb2cf >2013-12-09 09:00:46,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7056f704 >2013-12-09 09:00:46,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7056f704 >2013-12-09 09:00:46,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f853158 >2013-12-09 09:00:46,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f853158 >2013-12-09 09:00:51,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7238335f >2013-12-09 09:00:52,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7238335f >2013-12-09 09:00:52,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48c55de1 >2013-12-09 09:00:52,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48c55de1 >2013-12-09 09:00:57,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2095086 >2013-12-09 09:00:58,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2095086 >2013-12-09 09:00:58,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23ce952b >2013-12-09 09:00:58,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23ce952b >2013-12-09 09:01:03,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ed8f71c >2013-12-09 09:01:03,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ed8f71c >2013-12-09 09:01:03,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3aef7fa4 >2013-12-09 09:01:04,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3aef7fa4 >2013-12-09 09:01:09,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 404a9102 >2013-12-09 09:01:09,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 404a9102 >2013-12-09 09:01:09,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10115a1d >2013-12-09 09:01:09,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10115a1d >2013-12-09 09:01:14,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2be3442c >2013-12-09 09:01:15,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2be3442c >2013-12-09 09:01:15,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b887e00 >2013-12-09 09:01:15,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b887e00 >2013-12-09 09:01:20,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d38f38 >2013-12-09 09:01:21,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d38f38 >2013-12-09 09:01:21,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 780faa50 >2013-12-09 09:01:21,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 780faa50 >2013-12-09 09:01:26,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7432e514 >2013-12-09 09:01:27,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7432e514 >2013-12-09 09:01:27,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 384f6d1a >2013-12-09 09:01:27,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 384f6d1a >2013-12-09 09:01:30,232 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-94) No up server in cluster >2013-12-09 09:01:30,233 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-94) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:01:30,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 571dc52 >2013-12-09 09:01:30,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterTasksListVDSCommand, return: [], log id: 571dc52 >2013-12-09 09:01:32,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 252d471 >2013-12-09 09:01:32,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 252d471 >2013-12-09 09:01:32,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1fcba5b2 >2013-12-09 09:01:33,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1fcba5b2 >2013-12-09 09:01:38,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b96f347 >2013-12-09 09:01:38,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b96f347 >2013-12-09 09:01:38,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a62f9ef >2013-12-09 09:01:38,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a62f9ef >2013-12-09 09:01:43,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46e91796 >2013-12-09 09:01:44,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 46e91796 >2013-12-09 09:01:44,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47d95177 >2013-12-09 09:01:44,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47d95177 >2013-12-09 09:01:49,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 738277a >2013-12-09 09:01:50,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 738277a >2013-12-09 09:01:50,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2102563d >2013-12-09 09:01:50,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2102563d >2013-12-09 09:01:55,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f659c82 >2013-12-09 09:01:55,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f659c82 >2013-12-09 09:01:55,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c69c09 >2013-12-09 09:01:56,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c69c09 >2013-12-09 09:02:01,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 739d95de >2013-12-09 09:02:01,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 739d95de >2013-12-09 09:02:01,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d0632e5 >2013-12-09 09:02:01,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d0632e5 >2013-12-09 09:02:06,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2746f6f5 >2013-12-09 09:02:07,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2746f6f5 >2013-12-09 09:02:07,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 28de6987 >2013-12-09 09:02:07,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28de6987 >2013-12-09 09:02:12,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d10312f >2013-12-09 09:02:13,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d10312f >2013-12-09 09:02:13,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70bbd4bc >2013-12-09 09:02:13,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70bbd4bc >2013-12-09 09:02:18,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 206d7342 >2013-12-09 09:02:19,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 206d7342 >2013-12-09 09:02:19,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19500154 >2013-12-09 09:02:19,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19500154 >2013-12-09 09:02:24,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b8a40aa >2013-12-09 09:02:24,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1b8a40aa >2013-12-09 09:02:24,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e3ded4f >2013-12-09 09:02:25,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e3ded4f >2013-12-09 09:02:30,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f103552 >2013-12-09 09:02:30,517 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-82) No up server in cluster >2013-12-09 09:02:30,517 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-82) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:02:30,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33f84caa >2013-12-09 09:02:30,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5f103552 >2013-12-09 09:02:30,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 565d2649 >2013-12-09 09:02:30,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterTasksListVDSCommand, return: [], log id: 33f84caa >2013-12-09 09:02:30,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 565d2649 >2013-12-09 09:02:35,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18319635 >2013-12-09 09:02:36,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 18319635 >2013-12-09 09:02:36,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d41bef >2013-12-09 09:02:36,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d41bef >2013-12-09 09:02:41,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e42800d >2013-12-09 09:02:42,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e42800d >2013-12-09 09:02:42,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e6b8d20 >2013-12-09 09:02:42,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e6b8d20 >2013-12-09 09:02:47,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4dd4b943 >2013-12-09 09:02:47,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4dd4b943 >2013-12-09 09:02:47,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 265fb74c >2013-12-09 09:02:48,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 265fb74c >2013-12-09 09:02:53,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 365fbae9 >2013-12-09 09:02:53,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 365fbae9 >2013-12-09 09:02:53,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46b2e252 >2013-12-09 09:02:54,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46b2e252 >2013-12-09 09:02:59,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10ac51d5 >2013-12-09 09:02:59,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 10ac51d5 >2013-12-09 09:02:59,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3425827d >2013-12-09 09:02:59,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3425827d >2013-12-09 09:03:04,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a9f8be >2013-12-09 09:03:05,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4a9f8be >2013-12-09 09:03:05,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1de4ae28 >2013-12-09 09:03:05,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1de4ae28 >2013-12-09 09:03:10,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5cb3cbb1 >2013-12-09 09:03:11,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5cb3cbb1 >2013-12-09 09:03:11,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c4cf916 >2013-12-09 09:03:11,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c4cf916 >2013-12-09 09:03:16,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4fdfe807 >2013-12-09 09:03:16,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4fdfe807 >2013-12-09 09:03:16,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 361d6962 >2013-12-09 09:03:17,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 361d6962 >2013-12-09 09:03:22,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7debb233 >2013-12-09 09:03:22,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7debb233 >2013-12-09 09:03:22,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3296c8f5 >2013-12-09 09:03:22,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3296c8f5 >2013-12-09 09:03:27,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2838e268 >2013-12-09 09:03:28,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2838e268 >2013-12-09 09:03:28,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4de2601 >2013-12-09 09:03:28,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4de2601 >2013-12-09 09:03:30,777 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-7) No up server in cluster >2013-12-09 09:03:30,777 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-7) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:03:30,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 230d3638 >2013-12-09 09:03:31,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterTasksListVDSCommand, return: [], log id: 230d3638 >2013-12-09 09:03:33,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a41aa38 >2013-12-09 09:03:34,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: a41aa38 >2013-12-09 09:03:34,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39df4392 >2013-12-09 09:03:34,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39df4392 >2013-12-09 09:03:39,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 503885de >2013-12-09 09:03:39,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 503885de >2013-12-09 09:03:39,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 424b1358 >2013-12-09 09:03:40,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 424b1358 >2013-12-09 09:03:45,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 785c9b2e >2013-12-09 09:03:45,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 785c9b2e >2013-12-09 09:03:45,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25484e64 >2013-12-09 09:03:45,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25484e64 >2013-12-09 09:03:50,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5627ec93 >2013-12-09 09:03:51,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5627ec93 >2013-12-09 09:03:51,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78d1ab62 >2013-12-09 09:03:51,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78d1ab62 >2013-12-09 09:03:56,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d4e8052 >2013-12-09 09:03:57,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d4e8052 >2013-12-09 09:03:57,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a641a37 >2013-12-09 09:03:57,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a641a37 >2013-12-09 09:04:02,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2398d5b5 >2013-12-09 09:04:02,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2398d5b5 >2013-12-09 09:04:03,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4488cf23 >2013-12-09 09:04:03,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4488cf23 >2013-12-09 09:04:08,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fb99c8c >2013-12-09 09:04:08,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2fb99c8c >2013-12-09 09:04:08,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b91fd11 >2013-12-09 09:04:09,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b91fd11 >2013-12-09 09:04:14,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e08d5ca >2013-12-09 09:04:14,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6e08d5ca >2013-12-09 09:04:14,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e40ab88 >2013-12-09 09:04:14,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e40ab88 >2013-12-09 09:04:19,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5da77f40 >2013-12-09 09:04:20,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5da77f40 >2013-12-09 09:04:20,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7da24f89 >2013-12-09 09:04:20,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7da24f89 >2013-12-09 09:04:25,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29163180 >2013-12-09 09:04:26,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 29163180 >2013-12-09 09:04:26,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10da2b56 >2013-12-09 09:04:26,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10da2b56 >2013-12-09 09:04:31,057 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-81) No up server in cluster >2013-12-09 09:04:31,058 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-81) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:04:31,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 310548e6 >2013-12-09 09:04:31,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterTasksListVDSCommand, return: [], log id: 310548e6 >2013-12-09 09:04:31,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b2fae5 >2013-12-09 09:04:31,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: b2fae5 >2013-12-09 09:04:31,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 301c5579 >2013-12-09 09:04:32,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 301c5579 >2013-12-09 09:04:37,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6dbee25 >2013-12-09 09:04:37,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6dbee25 >2013-12-09 09:04:37,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48fc768b >2013-12-09 09:04:37,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48fc768b >2013-12-09 09:04:42,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a871253 >2013-12-09 09:04:43,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3a871253 >2013-12-09 09:04:43,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3fca6107 >2013-12-09 09:04:43,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3fca6107 >2013-12-09 09:04:48,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d19cfd4 >2013-12-09 09:04:49,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: d19cfd4 >2013-12-09 09:04:49,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14119b7e >2013-12-09 09:04:49,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14119b7e >2013-12-09 09:04:54,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e0ae7d >2013-12-09 09:04:55,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e0ae7d >2013-12-09 09:04:55,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: cce9311 >2013-12-09 09:04:55,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: cce9311 >2013-12-09 09:05:00,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 84443e0 >2013-12-09 09:05:00,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 84443e0 >2013-12-09 09:05:00,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1dcdb119 >2013-12-09 09:05:01,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1dcdb119 >2013-12-09 09:05:06,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2de3e12f >2013-12-09 09:05:06,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2de3e12f >2013-12-09 09:05:06,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23102000 >2013-12-09 09:05:06,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23102000 >2013-12-09 09:05:11,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 204fbca2 >2013-12-09 09:05:12,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 204fbca2 >2013-12-09 09:05:12,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c92136b >2013-12-09 09:05:12,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c92136b >2013-12-09 09:05:17,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36498d2d >2013-12-09 09:05:18,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 36498d2d >2013-12-09 09:05:18,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8e61bd9 >2013-12-09 09:05:18,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8e61bd9 >2013-12-09 09:05:23,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ff2c39d >2013-12-09 09:05:23,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7ff2c39d >2013-12-09 09:05:23,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a3eef6d >2013-12-09 09:05:24,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a3eef6d >2013-12-09 09:05:29,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67cc5edd >2013-12-09 09:05:29,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 67cc5edd >2013-12-09 09:05:29,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b8cfe01 >2013-12-09 09:05:29,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b8cfe01 >2013-12-09 09:05:31,341 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-86) No up server in cluster >2013-12-09 09:05:31,341 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-86) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:05:31,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39772147 >2013-12-09 09:05:31,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterTasksListVDSCommand, return: [], log id: 39772147 >2013-12-09 09:05:34,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f23276f >2013-12-09 09:05:35,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: f23276f >2013-12-09 09:05:35,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12c4ebac >2013-12-09 09:05:35,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12c4ebac >2013-12-09 09:05:40,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42aba177 >2013-12-09 09:05:41,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 42aba177 >2013-12-09 09:05:41,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3bb26b0c >2013-12-09 09:05:41,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3bb26b0c >2013-12-09 09:05:46,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f96dc9a >2013-12-09 09:05:47,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6f96dc9a >2013-12-09 09:05:47,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3cc80074 >2013-12-09 09:05:47,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3cc80074 >2013-12-09 09:05:52,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d39fd55 >2013-12-09 09:05:52,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2d39fd55 >2013-12-09 09:05:52,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a2063e7 >2013-12-09 09:05:53,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a2063e7 >2013-12-09 09:05:58,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 15d9b0f4 >2013-12-09 09:05:58,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 15d9b0f4 >2013-12-09 09:05:58,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 730cbb94 >2013-12-09 09:05:58,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 730cbb94 >2013-12-09 09:06:03,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57f9595a >2013-12-09 09:06:04,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 57f9595a >2013-12-09 09:06:04,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4dad9a78 >2013-12-09 09:06:04,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4dad9a78 >2013-12-09 09:06:09,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13d3cc00 >2013-12-09 09:06:10,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 13d3cc00 >2013-12-09 09:06:10,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e1f2a0c >2013-12-09 09:06:10,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e1f2a0c >2013-12-09 09:06:15,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b2f0070 >2013-12-09 09:06:15,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b2f0070 >2013-12-09 09:06:15,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3156fa >2013-12-09 09:06:16,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3156fa >2013-12-09 09:06:21,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10a82b87 >2013-12-09 09:06:21,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 10a82b87 >2013-12-09 09:06:21,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5650e419 >2013-12-09 09:06:21,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5650e419 >2013-12-09 09:06:27,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c05a9b5 >2013-12-09 09:06:27,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c05a9b5 >2013-12-09 09:06:27,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58748bf3 >2013-12-09 09:06:27,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58748bf3 >2013-12-09 09:06:31,629 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-97) No up server in cluster >2013-12-09 09:06:31,629 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-97) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:06:31,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57e4eef2 >2013-12-09 09:06:31,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterTasksListVDSCommand, return: [], log id: 57e4eef2 >2013-12-09 09:06:32,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c6af2aa >2013-12-09 09:06:33,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c6af2aa >2013-12-09 09:06:33,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e78fc2d >2013-12-09 09:06:33,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e78fc2d >2013-12-09 09:06:38,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b428f6e >2013-12-09 09:06:39,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: b428f6e >2013-12-09 09:06:39,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c412b16 >2013-12-09 09:06:39,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c412b16 >2013-12-09 09:06:44,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38a43b74 >2013-12-09 09:06:44,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 38a43b74 >2013-12-09 09:06:44,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5194f57d >2013-12-09 09:06:45,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5194f57d >2013-12-09 09:06:50,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5000fafb >2013-12-09 09:06:50,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5000fafb >2013-12-09 09:06:50,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78e9ec02 >2013-12-09 09:06:50,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78e9ec02 >2013-12-09 09:06:55,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e7c0db3 >2013-12-09 09:06:56,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e7c0db3 >2013-12-09 09:06:56,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 508ed128 >2013-12-09 09:06:56,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 508ed128 >2013-12-09 09:07:01,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44d3ce1b >2013-12-09 09:07:02,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 44d3ce1b >2013-12-09 09:07:02,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f530f4f >2013-12-09 09:07:02,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f530f4f >2013-12-09 09:07:07,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6fc0c74d >2013-12-09 09:07:08,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6fc0c74d >2013-12-09 09:07:08,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 60b2397b >2013-12-09 09:07:08,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60b2397b >2013-12-09 09:07:13,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28ab47d4 >2013-12-09 09:07:13,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 28ab47d4 >2013-12-09 09:07:13,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e77445d >2013-12-09 09:07:14,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e77445d >2013-12-09 09:07:19,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5904dd3 >2013-12-09 09:07:19,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5904dd3 >2013-12-09 09:07:19,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62fdfde4 >2013-12-09 09:07:19,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62fdfde4 >2013-12-09 09:07:24,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37cd808c >2013-12-09 09:07:25,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 37cd808c >2013-12-09 09:07:25,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 212017a1 >2013-12-09 09:07:25,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 212017a1 >2013-12-09 09:07:30,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2168e766 >2013-12-09 09:07:31,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2168e766 >2013-12-09 09:07:31,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d74e278 >2013-12-09 09:07:31,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d74e278 >2013-12-09 09:07:31,913 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-28) No up server in cluster >2013-12-09 09:07:31,913 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-28) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:07:31,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 214b58d5 >2013-12-09 09:07:32,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterTasksListVDSCommand, return: [], log id: 214b58d5 >2013-12-09 09:07:36,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c84bd63 >2013-12-09 09:07:36,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c84bd63 >2013-12-09 09:07:36,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36d3f77e >2013-12-09 09:07:37,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36d3f77e >2013-12-09 09:07:42,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ba800a8 >2013-12-09 09:07:42,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7ba800a8 >2013-12-09 09:07:42,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48bf768d >2013-12-09 09:07:42,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48bf768d >2013-12-09 09:07:47,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e41cb60 >2013-12-09 09:07:48,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: e41cb60 >2013-12-09 09:07:48,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47cb1bba >2013-12-09 09:07:48,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47cb1bba >2013-12-09 09:07:53,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50511078 >2013-12-09 09:07:54,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 50511078 >2013-12-09 09:07:54,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c961bf8 >2013-12-09 09:07:54,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c961bf8 >2013-12-09 09:07:59,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 649583c6 >2013-12-09 09:08:00,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 649583c6 >2013-12-09 09:08:00,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69e39e02 >2013-12-09 09:08:00,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69e39e02 >2013-12-09 09:08:05,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e57dbfe >2013-12-09 09:08:05,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e57dbfe >2013-12-09 09:08:05,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b2f8698 >2013-12-09 09:08:06,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b2f8698 >2013-12-09 09:08:11,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36ea28ee >2013-12-09 09:08:11,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 36ea28ee >2013-12-09 09:08:11,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 335d493c >2013-12-09 09:08:11,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 335d493c >2013-12-09 09:08:16,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6329b7a9 >2013-12-09 09:08:17,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6329b7a9 >2013-12-09 09:08:17,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c7f88a1 >2013-12-09 09:08:17,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c7f88a1 >2013-12-09 09:08:22,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78eb6b5a >2013-12-09 09:08:23,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 78eb6b5a >2013-12-09 09:08:23,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 192a8192 >2013-12-09 09:08:23,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 192a8192 >2013-12-09 09:08:28,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f00cffe >2013-12-09 09:08:28,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5f00cffe >2013-12-09 09:08:28,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40030500 >2013-12-09 09:08:29,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40030500 >2013-12-09 09:08:32,189 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-95) No up server in cluster >2013-12-09 09:08:32,189 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-95) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:08:32,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b9ebfb6 >2013-12-09 09:08:32,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterTasksListVDSCommand, return: [], log id: b9ebfb6 >2013-12-09 09:08:34,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 623a65d9 >2013-12-09 09:08:34,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 623a65d9 >2013-12-09 09:08:34,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6efc2f14 >2013-12-09 09:08:34,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6efc2f14 >2013-12-09 09:08:39,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1cda9136 >2013-12-09 09:08:40,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1cda9136 >2013-12-09 09:08:40,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 507ea92 >2013-12-09 09:08:40,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 507ea92 >2013-12-09 09:08:45,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c3cafc2 >2013-12-09 09:08:46,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c3cafc2 >2013-12-09 09:08:46,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a7c8bd3 >2013-12-09 09:08:46,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a7c8bd3 >2013-12-09 09:08:51,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e7ab3c8 >2013-12-09 09:08:52,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2e7ab3c8 >2013-12-09 09:08:52,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3548d512 >2013-12-09 09:08:52,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3548d512 >2013-12-09 09:08:57,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ecd178 >2013-12-09 09:08:57,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3ecd178 >2013-12-09 09:08:57,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e0c1363 >2013-12-09 09:08:58,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e0c1363 >2013-12-09 09:09:03,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5401ea11 >2013-12-09 09:09:03,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5401ea11 >2013-12-09 09:09:03,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74a517ff >2013-12-09 09:09:03,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74a517ff >2013-12-09 09:09:08,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ba786e6 >2013-12-09 09:09:09,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ba786e6 >2013-12-09 09:09:09,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b8ddbc7 >2013-12-09 09:09:09,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b8ddbc7 >2013-12-09 09:09:14,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a00a243 >2013-12-09 09:09:15,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: a00a243 >2013-12-09 09:09:15,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: dfafba8 >2013-12-09 09:09:15,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: dfafba8 >2013-12-09 09:09:20,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ab12fb5 >2013-12-09 09:09:20,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5ab12fb5 >2013-12-09 09:09:20,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36b95026 >2013-12-09 09:09:21,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36b95026 >2013-12-09 09:09:26,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e8a4d9 >2013-12-09 09:09:26,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e8a4d9 >2013-12-09 09:09:26,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3159b4aa >2013-12-09 09:09:26,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3159b4aa >2013-12-09 09:09:31,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35183d25 >2013-12-09 09:09:32,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 35183d25 >2013-12-09 09:09:32,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 721db82c >2013-12-09 09:09:32,470 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-72) No up server in cluster >2013-12-09 09:09:32,471 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-72) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:09:32,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e0366b5 >2013-12-09 09:09:32,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 721db82c >2013-12-09 09:09:32,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7e0366b5 >2013-12-09 09:09:37,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ca3fd02 >2013-12-09 09:09:38,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ca3fd02 >2013-12-09 09:09:38,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9794d82 >2013-12-09 09:09:38,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9794d82 >2013-12-09 09:09:43,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 593e5a6b >2013-12-09 09:09:44,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 593e5a6b >2013-12-09 09:09:44,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e213122 >2013-12-09 09:09:44,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e213122 >2013-12-09 09:09:49,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e668020 >2013-12-09 09:09:49,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e668020 >2013-12-09 09:09:49,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a85cbc8 >2013-12-09 09:09:50,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a85cbc8 >2013-12-09 09:09:55,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72d4d9e >2013-12-09 09:09:55,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 72d4d9e >2013-12-09 09:09:55,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7fe5da4e >2013-12-09 09:09:55,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fe5da4e >2013-12-09 09:10:00,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4656df23 >2013-12-09 09:10:01,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4656df23 >2013-12-09 09:10:01,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b5c933c >2013-12-09 09:10:01,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b5c933c >2013-12-09 09:10:06,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 584bb43d >2013-12-09 09:10:07,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 584bb43d >2013-12-09 09:10:07,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6231afe0 >2013-12-09 09:10:07,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6231afe0 >2013-12-09 09:10:12,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 132f1f4e >2013-12-09 09:10:12,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 132f1f4e >2013-12-09 09:10:12,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b7b4a39 >2013-12-09 09:10:13,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b7b4a39 >2013-12-09 09:10:18,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31446262 >2013-12-09 09:10:18,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 31446262 >2013-12-09 09:10:18,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5328b682 >2013-12-09 09:10:18,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5328b682 >2013-12-09 09:10:23,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29c6b924 >2013-12-09 09:10:24,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 29c6b924 >2013-12-09 09:10:24,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29c687f8 >2013-12-09 09:10:24,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29c687f8 >2013-12-09 09:10:29,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a634818 >2013-12-09 09:10:30,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: a634818 >2013-12-09 09:10:30,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e12abcc >2013-12-09 09:10:30,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e12abcc >2013-12-09 09:10:32,738 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-78) No up server in cluster >2013-12-09 09:10:32,738 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-78) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:10:32,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1fc736ee >2013-12-09 09:10:33,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1fc736ee >2013-12-09 09:10:35,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 920447a >2013-12-09 09:10:36,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 920447a >2013-12-09 09:10:36,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e5d6231 >2013-12-09 09:10:36,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e5d6231 >2013-12-09 09:10:41,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 761e9b8b >2013-12-09 09:10:41,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 761e9b8b >2013-12-09 09:10:41,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3216c49a >2013-12-09 09:10:42,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3216c49a >2013-12-09 09:10:47,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4aca339c >2013-12-09 09:10:47,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4aca339c >2013-12-09 09:10:47,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 177c77d >2013-12-09 09:10:47,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 177c77d >2013-12-09 09:10:52,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7cb16026 >2013-12-09 09:10:53,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7cb16026 >2013-12-09 09:10:53,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7dbf3245 >2013-12-09 09:10:53,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7dbf3245 >2013-12-09 09:10:58,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 14d603eb >2013-12-09 09:10:59,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 14d603eb >2013-12-09 09:10:59,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f74843b >2013-12-09 09:10:59,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f74843b >2013-12-09 09:11:04,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 636eb908 >2013-12-09 09:11:04,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 636eb908 >2013-12-09 09:11:04,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 414220a2 >2013-12-09 09:11:05,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 414220a2 >2013-12-09 09:11:10,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 634096ee >2013-12-09 09:11:10,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 634096ee >2013-12-09 09:11:10,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7222b0d2 >2013-12-09 09:11:10,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7222b0d2 >2013-12-09 09:11:15,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71e24509 >2013-12-09 09:11:16,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 71e24509 >2013-12-09 09:11:16,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 44ba8886 >2013-12-09 09:11:16,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44ba8886 >2013-12-09 09:11:21,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4eb36e60 >2013-12-09 09:11:22,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4eb36e60 >2013-12-09 09:11:22,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4835eb79 >2013-12-09 09:11:22,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4835eb79 >2013-12-09 09:11:27,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62a1486 >2013-12-09 09:11:28,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 62a1486 >2013-12-09 09:11:28,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78954981 >2013-12-09 09:11:28,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78954981 >2013-12-09 09:11:33,067 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-74) No up server in cluster >2013-12-09 09:11:33,068 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-74) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:11:33,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34510088 >2013-12-09 09:11:33,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69a6feeb >2013-12-09 09:11:33,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterTasksListVDSCommand, return: [], log id: 34510088 >2013-12-09 09:11:33,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 69a6feeb >2013-12-09 09:11:33,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 466a0c43 >2013-12-09 09:11:34,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 466a0c43 >2013-12-09 09:11:39,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1314c43d >2013-12-09 09:11:39,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1314c43d >2013-12-09 09:11:39,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3439bc09 >2013-12-09 09:11:39,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3439bc09 >2013-12-09 09:11:44,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1cef80a2 >2013-12-09 09:11:45,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1cef80a2 >2013-12-09 09:11:45,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42dff626 >2013-12-09 09:11:45,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42dff626 >2013-12-09 09:11:50,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 283b64c7 >2013-12-09 09:11:51,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 283b64c7 >2013-12-09 09:11:51,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 514a8b44 >2013-12-09 09:11:51,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 514a8b44 >2013-12-09 09:11:56,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 284d7536 >2013-12-09 09:11:56,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 284d7536 >2013-12-09 09:11:56,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b64c0cf >2013-12-09 09:11:57,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b64c0cf >2013-12-09 09:12:02,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f5c9e71 >2013-12-09 09:12:02,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f5c9e71 >2013-12-09 09:12:02,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6cace6c1 >2013-12-09 09:12:02,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6cace6c1 >2013-12-09 09:12:07,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6bf5cdd3 >2013-12-09 09:12:08,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6bf5cdd3 >2013-12-09 09:12:08,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50427413 >2013-12-09 09:12:08,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50427413 >2013-12-09 09:12:13,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69a0c4de >2013-12-09 09:12:14,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 69a0c4de >2013-12-09 09:12:14,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b617f55 >2013-12-09 09:12:14,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b617f55 >2013-12-09 09:12:19,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18088609 >2013-12-09 09:12:19,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 18088609 >2013-12-09 09:12:19,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ef7bbea >2013-12-09 09:12:20,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ef7bbea >2013-12-09 09:12:25,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: de85ca6 >2013-12-09 09:12:25,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: de85ca6 >2013-12-09 09:12:25,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55c164d9 >2013-12-09 09:12:26,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55c164d9 >2013-12-09 09:12:31,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e60cca8 >2013-12-09 09:12:31,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e60cca8 >2013-12-09 09:12:31,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72271bfe >2013-12-09 09:12:31,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72271bfe >2013-12-09 09:12:33,356 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-69) No up server in cluster >2013-12-09 09:12:33,356 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-69) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:12:33,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36e3d344 >2013-12-09 09:12:33,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterTasksListVDSCommand, return: [], log id: 36e3d344 >2013-12-09 09:12:36,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51b129e4 >2013-12-09 09:12:37,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 51b129e4 >2013-12-09 09:12:37,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 755c8c42 >2013-12-09 09:12:37,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 755c8c42 >2013-12-09 09:12:42,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 103dbb5d >2013-12-09 09:12:43,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 103dbb5d >2013-12-09 09:12:43,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b4102cd >2013-12-09 09:12:43,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b4102cd >2013-12-09 09:12:48,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7815795d >2013-12-09 09:12:48,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7815795d >2013-12-09 09:12:48,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f2ccb5a >2013-12-09 09:12:49,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f2ccb5a >2013-12-09 09:12:54,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1595ad1e >2013-12-09 09:12:54,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1595ad1e >2013-12-09 09:12:54,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 421e5977 >2013-12-09 09:12:54,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 421e5977 >2013-12-09 09:12:59,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4985ca1e >2013-12-09 09:13:00,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4985ca1e >2013-12-09 09:13:00,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6656dad1 >2013-12-09 09:13:00,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6656dad1 >2013-12-09 09:13:05,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 126c0040 >2013-12-09 09:13:06,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 126c0040 >2013-12-09 09:13:06,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51a37858 >2013-12-09 09:13:06,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51a37858 >2013-12-09 09:13:11,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a7eb9c0 >2013-12-09 09:13:12,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a7eb9c0 >2013-12-09 09:13:12,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 469aa4d9 >2013-12-09 09:13:12,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 469aa4d9 >2013-12-09 09:13:17,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4150866c >2013-12-09 09:13:17,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4150866c >2013-12-09 09:13:17,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 758eacd2 >2013-12-09 09:13:18,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 758eacd2 >2013-12-09 09:13:23,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19c4c1a9 >2013-12-09 09:13:23,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19c4c1a9 >2013-12-09 09:13:23,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2cc27254 >2013-12-09 09:13:23,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2cc27254 >2013-12-09 09:13:28,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36f817f8 >2013-12-09 09:13:29,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 36f817f8 >2013-12-09 09:13:29,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6982e523 >2013-12-09 09:13:29,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6982e523 >2013-12-09 09:13:33,619 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-49) No up server in cluster >2013-12-09 09:13:33,619 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-49) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:13:33,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c52bf6d >2013-12-09 09:13:33,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4c52bf6d >2013-12-09 09:13:34,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31d8b302 >2013-12-09 09:13:35,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 31d8b302 >2013-12-09 09:13:35,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ad93558 >2013-12-09 09:13:35,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ad93558 >2013-12-09 09:13:40,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 141993fe >2013-12-09 09:13:40,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 141993fe >2013-12-09 09:13:40,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 376f6139 >2013-12-09 09:13:41,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 376f6139 >2013-12-09 09:13:46,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3326fc7a >2013-12-09 09:13:46,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3326fc7a >2013-12-09 09:13:46,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 22a3a317 >2013-12-09 09:13:46,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22a3a317 >2013-12-09 09:13:51,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bc60aa9 >2013-12-09 09:13:52,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4bc60aa9 >2013-12-09 09:13:52,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7569d01e >2013-12-09 09:13:52,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7569d01e >2013-12-09 09:13:57,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 382a2ac7 >2013-12-09 09:13:58,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 382a2ac7 >2013-12-09 09:13:58,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a55258a >2013-12-09 09:13:58,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a55258a >2013-12-09 09:14:03,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f377fef >2013-12-09 09:14:04,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5f377fef >2013-12-09 09:14:04,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68ccd222 >2013-12-09 09:14:04,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68ccd222 >2013-12-09 09:14:09,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 475fe396 >2013-12-09 09:14:09,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 475fe396 >2013-12-09 09:14:09,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 403466f5 >2013-12-09 09:14:10,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 403466f5 >2013-12-09 09:14:15,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70e54c42 >2013-12-09 09:14:15,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 70e54c42 >2013-12-09 09:14:15,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4473f618 >2013-12-09 09:14:15,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4473f618 >2013-12-09 09:14:20,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 763d906c >2013-12-09 09:14:21,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 763d906c >2013-12-09 09:14:21,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f4f8887 >2013-12-09 09:14:21,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f4f8887 >2013-12-09 09:14:26,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7cd28372 >2013-12-09 09:14:27,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7cd28372 >2013-12-09 09:14:27,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1527ef05 >2013-12-09 09:14:27,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1527ef05 >2013-12-09 09:14:32,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51bdbfac >2013-12-09 09:14:32,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 51bdbfac >2013-12-09 09:14:32,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42a4ca4a >2013-12-09 09:14:33,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42a4ca4a >2013-12-09 09:14:33,903 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-36) No up server in cluster >2013-12-09 09:14:33,903 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-36) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:14:33,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61b91b1c >2013-12-09 09:14:34,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterTasksListVDSCommand, return: [], log id: 61b91b1c >2013-12-09 09:14:38,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: cfe24ab >2013-12-09 09:14:38,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: cfe24ab >2013-12-09 09:14:38,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 247afc6a >2013-12-09 09:14:38,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 247afc6a >2013-12-09 09:14:43,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2685e88a >2013-12-09 09:14:44,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2685e88a >2013-12-09 09:14:44,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7052f48f >2013-12-09 09:14:44,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7052f48f >2013-12-09 09:14:49,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7052ad99 >2013-12-09 09:14:50,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7052ad99 >2013-12-09 09:14:50,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5195661e >2013-12-09 09:14:50,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5195661e >2013-12-09 09:14:55,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55e1b977 >2013-12-09 09:14:56,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 55e1b977 >2013-12-09 09:14:56,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 514fb3c8 >2013-12-09 09:14:56,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 514fb3c8 >2013-12-09 09:15:01,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4975de10 >2013-12-09 09:15:01,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4975de10 >2013-12-09 09:15:01,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66d5c0bf >2013-12-09 09:15:02,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66d5c0bf >2013-12-09 09:15:07,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1482f214 >2013-12-09 09:15:07,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1482f214 >2013-12-09 09:15:07,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b272589 >2013-12-09 09:15:07,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b272589 >2013-12-09 09:15:12,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d046925 >2013-12-09 09:15:13,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d046925 >2013-12-09 09:15:13,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33b47d95 >2013-12-09 09:15:13,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33b47d95 >2013-12-09 09:15:18,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ad4fddb >2013-12-09 09:15:19,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7ad4fddb >2013-12-09 09:15:19,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26232fe7 >2013-12-09 09:15:19,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26232fe7 >2013-12-09 09:15:24,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f7fe069 >2013-12-09 09:15:24,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f7fe069 >2013-12-09 09:15:24,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 28ad631d >2013-12-09 09:15:25,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28ad631d >2013-12-09 09:15:30,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a61548 >2013-12-09 09:15:30,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a61548 >2013-12-09 09:15:30,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11c5d78 >2013-12-09 09:15:31,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11c5d78 >2013-12-09 09:15:34,178 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-26) No up server in cluster >2013-12-09 09:15:34,179 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-26) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:15:34,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18fca358 >2013-12-09 09:15:34,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterTasksListVDSCommand, return: [], log id: 18fca358 >2013-12-09 09:15:36,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 300ce268 >2013-12-09 09:15:36,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 300ce268 >2013-12-09 09:15:36,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c46f973 >2013-12-09 09:15:36,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c46f973 >2013-12-09 09:15:41,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7983cded >2013-12-09 09:15:42,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7983cded >2013-12-09 09:15:42,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 510e6630 >2013-12-09 09:15:42,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 510e6630 >2013-12-09 09:15:47,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a071133 >2013-12-09 09:15:48,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2a071133 >2013-12-09 09:15:48,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 326cd9ca >2013-12-09 09:15:48,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 326cd9ca >2013-12-09 09:15:53,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20f49cf1 >2013-12-09 09:15:54,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 20f49cf1 >2013-12-09 09:15:54,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c389ce9 >2013-12-09 09:15:54,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c389ce9 >2013-12-09 09:15:59,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5acc9aa9 >2013-12-09 09:15:59,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5acc9aa9 >2013-12-09 09:15:59,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a17b9d1 >2013-12-09 09:16:00,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a17b9d1 >2013-12-09 09:16:05,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19eda22a >2013-12-09 09:16:05,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 19eda22a >2013-12-09 09:16:05,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 463f6667 >2013-12-09 09:16:05,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 463f6667 >2013-12-09 09:16:10,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1798d397 >2013-12-09 09:16:11,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1798d397 >2013-12-09 09:16:11,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1deb0c42 >2013-12-09 09:16:11,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1deb0c42 >2013-12-09 09:16:16,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4471528a >2013-12-09 09:16:17,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4471528a >2013-12-09 09:16:17,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21c109bd >2013-12-09 09:16:17,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21c109bd >2013-12-09 09:16:22,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56659368 >2013-12-09 09:16:23,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 56659368 >2013-12-09 09:16:23,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a3c1a5f >2013-12-09 09:16:23,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a3c1a5f >2013-12-09 09:16:28,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24d6d0f0 >2013-12-09 09:16:28,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 24d6d0f0 >2013-12-09 09:16:28,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c0f82e7 >2013-12-09 09:16:29,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c0f82e7 >2013-12-09 09:16:34,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17796221 >2013-12-09 09:16:34,441 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-73) No up server in cluster >2013-12-09 09:16:34,441 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-73) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:16:34,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42c692e7 >2013-12-09 09:16:34,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 17796221 >2013-12-09 09:16:34,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b6bf8b8 >2013-12-09 09:16:34,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterTasksListVDSCommand, return: [], log id: 42c692e7 >2013-12-09 09:16:34,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b6bf8b8 >2013-12-09 09:16:39,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c955ede >2013-12-09 09:16:40,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1c955ede >2013-12-09 09:16:40,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1587f50 >2013-12-09 09:16:40,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1587f50 >2013-12-09 09:16:45,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f2ee98d >2013-12-09 09:16:46,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5f2ee98d >2013-12-09 09:16:46,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66b1f >2013-12-09 09:16:46,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66b1f >2013-12-09 09:16:51,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 194b90be >2013-12-09 09:16:52,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 194b90be >2013-12-09 09:16:52,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b3f7d9c >2013-12-09 09:16:52,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b3f7d9c >2013-12-09 09:16:57,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a8b789d >2013-12-09 09:16:57,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a8b789d >2013-12-09 09:16:57,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3bf46c2c >2013-12-09 09:16:58,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3bf46c2c >2013-12-09 09:17:03,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e125f72 >2013-12-09 09:17:03,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1e125f72 >2013-12-09 09:17:03,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14281a93 >2013-12-09 09:17:03,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14281a93 >2013-12-09 09:17:08,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 419861c8 >2013-12-09 09:17:09,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 419861c8 >2013-12-09 09:17:09,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75cc4181 >2013-12-09 09:17:09,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75cc4181 >2013-12-09 09:17:14,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b83aad5 >2013-12-09 09:17:15,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: b83aad5 >2013-12-09 09:17:15,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37cdff9 >2013-12-09 09:17:15,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37cdff9 >2013-12-09 09:17:20,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f4044f4 >2013-12-09 09:17:20,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f4044f4 >2013-12-09 09:17:20,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56193377 >2013-12-09 09:17:21,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56193377 >2013-12-09 09:17:26,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48d87b35 >2013-12-09 09:17:26,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 48d87b35 >2013-12-09 09:17:26,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20147d4d >2013-12-09 09:17:26,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20147d4d >2013-12-09 09:17:31,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 106a853f >2013-12-09 09:17:32,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 106a853f >2013-12-09 09:17:32,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3267292 >2013-12-09 09:17:32,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3267292 >2013-12-09 09:17:34,706 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-18) No up server in cluster >2013-12-09 09:17:34,706 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-18) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:17:34,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f125f66 >2013-12-09 09:17:34,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7f125f66 >2013-12-09 09:17:37,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f9729ce >2013-12-09 09:17:38,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5f9729ce >2013-12-09 09:17:38,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32e008f5 >2013-12-09 09:17:38,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32e008f5 >2013-12-09 09:17:43,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1daaf17f >2013-12-09 09:17:44,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1daaf17f >2013-12-09 09:17:44,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72478fbb >2013-12-09 09:17:44,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72478fbb >2013-12-09 09:17:49,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ea24521 >2013-12-09 09:17:49,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3ea24521 >2013-12-09 09:17:49,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 717e4aed >2013-12-09 09:17:50,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 717e4aed >2013-12-09 09:17:55,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15ae9221 >2013-12-09 09:17:55,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 15ae9221 >2013-12-09 09:17:55,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48583df6 >2013-12-09 09:17:55,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48583df6 >2013-12-09 09:18:00,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2123978 >2013-12-09 09:18:01,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2123978 >2013-12-09 09:18:01,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c5276c1 >2013-12-09 09:18:01,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c5276c1 >2013-12-09 09:18:06,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2bc8dfc9 >2013-12-09 09:18:07,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2bc8dfc9 >2013-12-09 09:18:07,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 439b4e59 >2013-12-09 09:18:07,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 439b4e59 >2013-12-09 09:18:12,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c8863b5 >2013-12-09 09:18:12,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c8863b5 >2013-12-09 09:18:12,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 753fad4e >2013-12-09 09:18:13,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 753fad4e >2013-12-09 09:18:18,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70339a8c >2013-12-09 09:18:18,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 70339a8c >2013-12-09 09:18:18,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c7f6bae >2013-12-09 09:18:18,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c7f6bae >2013-12-09 09:18:23,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 430312bf >2013-12-09 09:18:24,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 430312bf >2013-12-09 09:18:24,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e365911 >2013-12-09 09:18:24,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e365911 >2013-12-09 09:18:29,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 588563d5 >2013-12-09 09:18:30,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 588563d5 >2013-12-09 09:18:30,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fdfcbc2 >2013-12-09 09:18:30,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fdfcbc2 >2013-12-09 09:18:34,987 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-35) No up server in cluster >2013-12-09 09:18:34,988 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-35) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:18:34,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 473f3b57 >2013-12-09 09:18:35,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterTasksListVDSCommand, return: [], log id: 473f3b57 >2013-12-09 09:18:35,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62f0c2b0 >2013-12-09 09:18:35,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 62f0c2b0 >2013-12-09 09:18:35,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 434e0593 >2013-12-09 09:18:36,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 434e0593 >2013-12-09 09:18:41,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5375bfa5 >2013-12-09 09:18:41,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5375bfa5 >2013-12-09 09:18:41,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 381fa278 >2013-12-09 09:18:42,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 381fa278 >2013-12-09 09:18:47,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7047e71f >2013-12-09 09:18:47,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7047e71f >2013-12-09 09:18:47,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 470bb918 >2013-12-09 09:18:47,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 470bb918 >2013-12-09 09:18:52,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 404b08ea >2013-12-09 09:18:53,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 404b08ea >2013-12-09 09:18:53,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 799c8989 >2013-12-09 09:18:53,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 799c8989 >2013-12-09 09:18:58,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54b2dff4 >2013-12-09 09:18:59,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 54b2dff4 >2013-12-09 09:18:59,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 412b14e8 >2013-12-09 09:18:59,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 412b14e8 >2013-12-09 09:19:04,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3157298f >2013-12-09 09:19:04,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3157298f >2013-12-09 09:19:04,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a97fdfb >2013-12-09 09:19:05,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a97fdfb >2013-12-09 09:19:10,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b68febd >2013-12-09 09:19:10,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5b68febd >2013-12-09 09:19:10,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4145146 >2013-12-09 09:19:10,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4145146 >2013-12-09 09:19:15,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 399a4579 >2013-12-09 09:19:16,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 399a4579 >2013-12-09 09:19:16,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 60132423 >2013-12-09 09:19:16,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60132423 >2013-12-09 09:19:21,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 213d5f6a >2013-12-09 09:19:22,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 213d5f6a >2013-12-09 09:19:22,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79ed0156 >2013-12-09 09:19:22,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79ed0156 >2013-12-09 09:19:27,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e189074 >2013-12-09 09:19:28,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3e189074 >2013-12-09 09:19:28,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3fffaabf >2013-12-09 09:19:28,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3fffaabf >2013-12-09 09:19:33,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46f45bf2 >2013-12-09 09:19:33,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 46f45bf2 >2013-12-09 09:19:33,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 504988bd >2013-12-09 09:19:34,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 504988bd >2013-12-09 09:19:35,268 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-63) No up server in cluster >2013-12-09 09:19:35,269 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-63) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:19:35,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31a5bd6f >2013-12-09 09:19:35,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterTasksListVDSCommand, return: [], log id: 31a5bd6f >2013-12-09 09:19:39,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 80457e9 >2013-12-09 09:19:39,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 80457e9 >2013-12-09 09:19:39,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 227064a5 >2013-12-09 09:19:39,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 227064a5 >2013-12-09 09:19:44,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ee12980 >2013-12-09 09:19:45,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1ee12980 >2013-12-09 09:19:45,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13c619c >2013-12-09 09:19:45,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13c619c >2013-12-09 09:19:50,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1cffb90c >2013-12-09 09:19:51,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1cffb90c >2013-12-09 09:19:51,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18d4212d >2013-12-09 09:19:51,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18d4212d >2013-12-09 09:19:56,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 587c9334 >2013-12-09 09:19:56,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 587c9334 >2013-12-09 09:19:56,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5656158 >2013-12-09 09:19:57,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5656158 >2013-12-09 09:20:02,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c77f940 >2013-12-09 09:20:02,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c77f940 >2013-12-09 09:20:02,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11e9f726 >2013-12-09 09:20:02,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11e9f726 >2013-12-09 09:20:07,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61aa19b8 >2013-12-09 09:20:08,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 61aa19b8 >2013-12-09 09:20:08,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37d4e1aa >2013-12-09 09:20:08,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37d4e1aa >2013-12-09 09:20:13,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 111e0b89 >2013-12-09 09:20:14,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 111e0b89 >2013-12-09 09:20:14,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40fb7a00 >2013-12-09 09:20:14,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40fb7a00 >2013-12-09 09:20:19,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78f0abe6 >2013-12-09 09:20:19,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 78f0abe6 >2013-12-09 09:20:19,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d76046b >2013-12-09 09:20:20,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d76046b >2013-12-09 09:20:25,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b8d91b7 >2013-12-09 09:20:25,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: b8d91b7 >2013-12-09 09:20:25,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 24e41b49 >2013-12-09 09:20:25,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24e41b49 >2013-12-09 09:20:31,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2971d70e >2013-12-09 09:20:31,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2971d70e >2013-12-09 09:20:31,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39e70077 >2013-12-09 09:20:31,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39e70077 >2013-12-09 09:20:35,556 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-44) No up server in cluster >2013-12-09 09:20:35,556 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-44) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:20:35,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79c18c39 >2013-12-09 09:20:35,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterTasksListVDSCommand, return: [], log id: 79c18c39 >2013-12-09 09:20:36,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40ff8c98 >2013-12-09 09:20:37,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 40ff8c98 >2013-12-09 09:20:37,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1308809 >2013-12-09 09:20:37,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1308809 >2013-12-09 09:20:42,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 315560bf >2013-12-09 09:20:43,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 315560bf >2013-12-09 09:20:43,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1da9ac71 >2013-12-09 09:20:43,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1da9ac71 >2013-12-09 09:20:48,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ee52053 >2013-12-09 09:20:48,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2ee52053 >2013-12-09 09:20:48,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 256d2029 >2013-12-09 09:20:49,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 256d2029 >2013-12-09 09:20:54,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 604baa3a >2013-12-09 09:20:54,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 604baa3a >2013-12-09 09:20:54,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 294d7e3 >2013-12-09 09:20:54,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 294d7e3 >2013-12-09 09:20:59,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c44cafc >2013-12-09 09:21:00,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c44cafc >2013-12-09 09:21:00,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12b18dce >2013-12-09 09:21:00,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12b18dce >2013-12-09 09:21:05,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36918d91 >2013-12-09 09:21:06,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 36918d91 >2013-12-09 09:21:06,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b589d9f >2013-12-09 09:21:06,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b589d9f >2013-12-09 09:21:11,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 770d8b5a >2013-12-09 09:21:12,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 770d8b5a >2013-12-09 09:21:12,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 102f76fb >2013-12-09 09:21:12,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 102f76fb >2013-12-09 09:21:17,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12aa31f7 >2013-12-09 09:21:17,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 12aa31f7 >2013-12-09 09:21:17,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2aa7086f >2013-12-09 09:21:18,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2aa7086f >2013-12-09 09:21:23,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4af2bc93 >2013-12-09 09:21:23,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4af2bc93 >2013-12-09 09:21:23,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f2eb90e >2013-12-09 09:21:23,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f2eb90e >2013-12-09 09:21:28,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3129fcdc >2013-12-09 09:21:29,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3129fcdc >2013-12-09 09:21:29,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 607886b3 >2013-12-09 09:21:29,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 607886b3 >2013-12-09 09:21:34,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7de40074 >2013-12-09 09:21:35,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7de40074 >2013-12-09 09:21:35,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19913bac >2013-12-09 09:21:35,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19913bac >2013-12-09 09:21:35,839 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-45) No up server in cluster >2013-12-09 09:21:35,839 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-45) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:21:35,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 25608394 >2013-12-09 09:21:36,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterTasksListVDSCommand, return: [], log id: 25608394 >2013-12-09 09:21:40,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40512671 >2013-12-09 09:21:40,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 40512671 >2013-12-09 09:21:40,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 842fdd >2013-12-09 09:21:41,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 842fdd >2013-12-09 09:21:46,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f3baa35 >2013-12-09 09:21:46,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f3baa35 >2013-12-09 09:21:46,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75199021 >2013-12-09 09:21:46,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75199021 >2013-12-09 09:21:51,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6690cd3d >2013-12-09 09:21:52,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6690cd3d >2013-12-09 09:21:52,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c020564 >2013-12-09 09:21:52,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c020564 >2013-12-09 09:21:57,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1798fcd4 >2013-12-09 09:21:58,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1798fcd4 >2013-12-09 09:21:58,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5bc8d005 >2013-12-09 09:21:58,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5bc8d005 >2013-12-09 09:22:03,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c83ae02 >2013-12-09 09:22:04,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c83ae02 >2013-12-09 09:22:04,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5fb737f0 >2013-12-09 09:22:04,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fb737f0 >2013-12-09 09:22:09,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54f7a039 >2013-12-09 09:22:09,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 54f7a039 >2013-12-09 09:22:09,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 675c5fa3 >2013-12-09 09:22:10,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 675c5fa3 >2013-12-09 09:22:15,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c64de30 >2013-12-09 09:22:15,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2c64de30 >2013-12-09 09:22:15,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e0e3dbb >2013-12-09 09:22:15,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e0e3dbb >2013-12-09 09:22:20,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16cddef9 >2013-12-09 09:22:21,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 16cddef9 >2013-12-09 09:22:21,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1850d186 >2013-12-09 09:22:21,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1850d186 >2013-12-09 09:22:26,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d9183cc >2013-12-09 09:22:27,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d9183cc >2013-12-09 09:22:27,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f9027a >2013-12-09 09:22:27,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f9027a >2013-12-09 09:22:32,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c35578 >2013-12-09 09:22:32,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1c35578 >2013-12-09 09:22:32,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70e43894 >2013-12-09 09:22:33,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70e43894 >2013-12-09 09:22:36,119 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-87) No up server in cluster >2013-12-09 09:22:36,119 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-87) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:22:36,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1724c61e >2013-12-09 09:22:36,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1724c61e >2013-12-09 09:22:38,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 161291f4 >2013-12-09 09:22:38,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 161291f4 >2013-12-09 09:22:38,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6666ff >2013-12-09 09:22:38,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6666ff >2013-12-09 09:22:43,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 588bce5a >2013-12-09 09:22:44,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 588bce5a >2013-12-09 09:22:44,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2bb1e904 >2013-12-09 09:22:44,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bb1e904 >2013-12-09 09:22:49,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12943e57 >2013-12-09 09:22:50,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 12943e57 >2013-12-09 09:22:50,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59a9bcaf >2013-12-09 09:22:50,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59a9bcaf >2013-12-09 09:22:55,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 359fa666 >2013-12-09 09:22:56,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 359fa666 >2013-12-09 09:22:56,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5515c7bb >2013-12-09 09:22:56,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5515c7bb >2013-12-09 09:23:01,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1af2f43e >2013-12-09 09:23:01,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1af2f43e >2013-12-09 09:23:01,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a86fa21 >2013-12-09 09:23:02,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a86fa21 >2013-12-09 09:23:07,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11fec61e >2013-12-09 09:23:07,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 11fec61e >2013-12-09 09:23:07,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77144742 >2013-12-09 09:23:07,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77144742 >2013-12-09 09:23:12,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6147c754 >2013-12-09 09:23:13,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6147c754 >2013-12-09 09:23:13,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 256b42e7 >2013-12-09 09:23:13,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 256b42e7 >2013-12-09 09:23:18,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a3707bc >2013-12-09 09:23:19,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2a3707bc >2013-12-09 09:23:19,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e9184aa >2013-12-09 09:23:19,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e9184aa >2013-12-09 09:23:24,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 221c1022 >2013-12-09 09:23:24,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 221c1022 >2013-12-09 09:23:24,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 765b2e53 >2013-12-09 09:23:25,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 765b2e53 >2013-12-09 09:23:30,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3dcb73e6 >2013-12-09 09:23:30,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3dcb73e6 >2013-12-09 09:23:30,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 271bc8ae >2013-12-09 09:23:30,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 271bc8ae >2013-12-09 09:23:35,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3810d7be >2013-12-09 09:23:36,406 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-88) No up server in cluster >2013-12-09 09:23:36,406 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-88) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:23:36,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e6fb5f6 >2013-12-09 09:23:36,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3810d7be >2013-12-09 09:23:36,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4942f100 >2013-12-09 09:23:36,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4942f100 >2013-12-09 09:23:36,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6e6fb5f6 >2013-12-09 09:23:41,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c178adc >2013-12-09 09:23:42,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c178adc >2013-12-09 09:23:42,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 24721660 >2013-12-09 09:23:42,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24721660 >2013-12-09 09:23:47,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d2831b6 >2013-12-09 09:23:48,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d2831b6 >2013-12-09 09:23:48,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73b6866f >2013-12-09 09:23:48,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73b6866f >2013-12-09 09:23:53,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c82cd7a >2013-12-09 09:23:53,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c82cd7a >2013-12-09 09:23:53,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e395ae3 >2013-12-09 09:23:54,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e395ae3 >2013-12-09 09:23:59,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16ba8a77 >2013-12-09 09:23:59,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 16ba8a77 >2013-12-09 09:23:59,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ac00e4a >2013-12-09 09:23:59,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ac00e4a >2013-12-09 09:24:04,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d5d7f8f >2013-12-09 09:24:05,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: d5d7f8f >2013-12-09 09:24:05,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20684f3f >2013-12-09 09:24:05,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20684f3f >2013-12-09 09:24:10,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4275120f >2013-12-09 09:24:11,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4275120f >2013-12-09 09:24:11,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1feb732 >2013-12-09 09:24:11,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1feb732 >2013-12-09 09:24:16,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31981d8d >2013-12-09 09:24:16,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 31981d8d >2013-12-09 09:24:16,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76cead6a >2013-12-09 09:24:17,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76cead6a >2013-12-09 09:24:22,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63023ba6 >2013-12-09 09:24:22,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 63023ba6 >2013-12-09 09:24:22,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6fe2226 >2013-12-09 09:24:22,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6fe2226 >2013-12-09 09:24:27,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 474a2d48 >2013-12-09 09:24:28,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 474a2d48 >2013-12-09 09:24:28,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56c70e30 >2013-12-09 09:24:28,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56c70e30 >2013-12-09 09:24:33,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d9fb369 >2013-12-09 09:24:34,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d9fb369 >2013-12-09 09:24:34,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41cb08fd >2013-12-09 09:24:34,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41cb08fd >2013-12-09 09:24:36,689 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-67) No up server in cluster >2013-12-09 09:24:36,690 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-67) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:24:36,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72df7427 >2013-12-09 09:24:36,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterTasksListVDSCommand, return: [], log id: 72df7427 >2013-12-09 09:24:39,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e9aa5dd >2013-12-09 09:24:39,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2e9aa5dd >2013-12-09 09:24:39,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 173ed562 >2013-12-09 09:24:40,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 173ed562 >2013-12-09 09:24:45,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b220f5c >2013-12-09 09:24:45,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b220f5c >2013-12-09 09:24:45,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72ac0ac1 >2013-12-09 09:24:45,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72ac0ac1 >2013-12-09 09:24:50,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 581619e5 >2013-12-09 09:24:51,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 581619e5 >2013-12-09 09:24:51,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36ca3620 >2013-12-09 09:24:51,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36ca3620 >2013-12-09 09:24:56,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68c83114 >2013-12-09 09:24:57,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 68c83114 >2013-12-09 09:24:57,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43bb74a9 >2013-12-09 09:24:57,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43bb74a9 >2013-12-09 09:25:02,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 201ee9a7 >2013-12-09 09:25:03,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 201ee9a7 >2013-12-09 09:25:03,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12f4c924 >2013-12-09 09:25:03,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12f4c924 >2013-12-09 09:25:08,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3974119 >2013-12-09 09:25:08,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3974119 >2013-12-09 09:25:08,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53475e5a >2013-12-09 09:25:09,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53475e5a >2013-12-09 09:25:14,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3982bc34 >2013-12-09 09:25:14,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3982bc34 >2013-12-09 09:25:14,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f9b322b >2013-12-09 09:25:14,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f9b322b >2013-12-09 09:25:19,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5bbbc06a >2013-12-09 09:25:20,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5bbbc06a >2013-12-09 09:25:20,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 622231ab >2013-12-09 09:25:20,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 622231ab >2013-12-09 09:25:25,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e12c06a >2013-12-09 09:25:26,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2e12c06a >2013-12-09 09:25:26,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: fc6b825 >2013-12-09 09:25:26,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: fc6b825 >2013-12-09 09:25:31,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e6324fe >2013-12-09 09:25:31,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e6324fe >2013-12-09 09:25:31,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c4bb787 >2013-12-09 09:25:32,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c4bb787 >2013-12-09 09:25:36,976 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-6) No up server in cluster >2013-12-09 09:25:36,976 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-6) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:25:36,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33e16835 >2013-12-09 09:25:37,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75098b18 >2013-12-09 09:25:37,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterTasksListVDSCommand, return: [], log id: 33e16835 >2013-12-09 09:25:37,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 75098b18 >2013-12-09 09:25:37,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f8c235 >2013-12-09 09:25:38,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f8c235 >2013-12-09 09:25:43,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73045c1 >2013-12-09 09:25:43,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 73045c1 >2013-12-09 09:25:43,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57f815fd >2013-12-09 09:25:43,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57f815fd >2013-12-09 09:25:48,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ddeee8d >2013-12-09 09:25:49,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ddeee8d >2013-12-09 09:25:49,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4bcdff83 >2013-12-09 09:25:49,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4bcdff83 >2013-12-09 09:25:54,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27090298 >2013-12-09 09:25:55,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 27090298 >2013-12-09 09:25:55,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 579c8cfc >2013-12-09 09:25:55,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 579c8cfc >2013-12-09 09:26:00,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5805faf >2013-12-09 09:26:00,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5805faf >2013-12-09 09:26:00,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 535be941 >2013-12-09 09:26:01,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 535be941 >2013-12-09 09:26:06,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18773c3a >2013-12-09 09:26:06,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 18773c3a >2013-12-09 09:26:06,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b9945d0 >2013-12-09 09:26:06,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b9945d0 >2013-12-09 09:26:11,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57c697f8 >2013-12-09 09:26:12,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 57c697f8 >2013-12-09 09:26:12,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d6942b8 >2013-12-09 09:26:12,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d6942b8 >2013-12-09 09:26:17,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 404b3d5b >2013-12-09 09:26:18,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 404b3d5b >2013-12-09 09:26:18,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62f88fd1 >2013-12-09 09:26:18,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62f88fd1 >2013-12-09 09:26:23,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75c329e2 >2013-12-09 09:26:24,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 75c329e2 >2013-12-09 09:26:24,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 493577ed >2013-12-09 09:26:24,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 493577ed >2013-12-09 09:26:29,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 341766c9 >2013-12-09 09:26:29,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 341766c9 >2013-12-09 09:26:29,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1198fc0 >2013-12-09 09:26:30,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1198fc0 >2013-12-09 09:26:35,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34825c46 >2013-12-09 09:26:35,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 34825c46 >2013-12-09 09:26:35,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c9353a1 >2013-12-09 09:26:35,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c9353a1 >2013-12-09 09:26:37,280 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-72) No up server in cluster >2013-12-09 09:26:37,280 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-72) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:26:37,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f50d98c >2013-12-09 09:26:37,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterTasksListVDSCommand, return: [], log id: f50d98c >2013-12-09 09:26:40,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 85e5bb >2013-12-09 09:26:41,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 85e5bb >2013-12-09 09:26:41,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4cf10e4 >2013-12-09 09:26:41,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4cf10e4 >2013-12-09 09:26:46,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d88f7a >2013-12-09 09:26:47,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d88f7a >2013-12-09 09:26:47,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 49ffe2bf >2013-12-09 09:26:47,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49ffe2bf >2013-12-09 09:26:52,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16fe536b >2013-12-09 09:26:53,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 16fe536b >2013-12-09 09:26:53,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23ed79b6 >2013-12-09 09:26:53,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23ed79b6 >2013-12-09 09:26:58,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 657c6cd5 >2013-12-09 09:26:58,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 657c6cd5 >2013-12-09 09:26:58,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 126fc814 >2013-12-09 09:26:59,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 126fc814 >2013-12-09 09:27:04,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7607dcf5 >2013-12-09 09:27:04,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7607dcf5 >2013-12-09 09:27:04,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e17d727 >2013-12-09 09:27:04,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e17d727 >2013-12-09 09:27:09,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fce4fdf >2013-12-09 09:27:10,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2fce4fdf >2013-12-09 09:27:10,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ad89246 >2013-12-09 09:27:10,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ad89246 >2013-12-09 09:27:15,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6eaa20b5 >2013-12-09 09:27:16,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6eaa20b5 >2013-12-09 09:27:16,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6acbc0bc >2013-12-09 09:27:16,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6acbc0bc >2013-12-09 09:27:21,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 752a5dbc >2013-12-09 09:27:21,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 752a5dbc >2013-12-09 09:27:21,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62517d6d >2013-12-09 09:27:22,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62517d6d >2013-12-09 09:27:27,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f604773 >2013-12-09 09:27:27,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: f604773 >2013-12-09 09:27:27,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a1e7fe3 >2013-12-09 09:27:28,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a1e7fe3 >2013-12-09 09:27:33,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: da98628 >2013-12-09 09:27:33,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: da98628 >2013-12-09 09:27:33,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 587b166a >2013-12-09 09:27:33,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 587b166a >2013-12-09 09:27:37,568 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) No up server in cluster >2013-12-09 09:27:37,568 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:27:37,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 613305bd >2013-12-09 09:27:37,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterTasksListVDSCommand, return: [], log id: 613305bd >2013-12-09 09:27:38,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 343b1388 >2013-12-09 09:27:39,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 343b1388 >2013-12-09 09:27:39,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e04d983 >2013-12-09 09:27:39,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e04d983 >2013-12-09 09:27:44,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58d1417c >2013-12-09 09:27:45,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 58d1417c >2013-12-09 09:27:45,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 666afc45 >2013-12-09 09:27:45,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 666afc45 >2013-12-09 09:27:50,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3576e1f2 >2013-12-09 09:27:50,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3576e1f2 >2013-12-09 09:27:50,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f4ac5f6 >2013-12-09 09:27:51,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f4ac5f6 >2013-12-09 09:27:56,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67d77dd0 >2013-12-09 09:27:56,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 67d77dd0 >2013-12-09 09:27:56,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 724c7ec1 >2013-12-09 09:27:56,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 724c7ec1 >2013-12-09 09:28:01,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2023fd1f >2013-12-09 09:28:02,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2023fd1f >2013-12-09 09:28:02,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69ae42d6 >2013-12-09 09:28:02,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69ae42d6 >2013-12-09 09:28:07,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 727bd21b >2013-12-09 09:28:08,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 727bd21b >2013-12-09 09:28:08,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6fd46df2 >2013-12-09 09:28:08,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6fd46df2 >2013-12-09 09:28:13,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3938ef5 >2013-12-09 09:28:13,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3938ef5 >2013-12-09 09:28:13,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ce997c6 >2013-12-09 09:28:14,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ce997c6 >2013-12-09 09:28:19,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38b9b1c2 >2013-12-09 09:28:19,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 38b9b1c2 >2013-12-09 09:28:19,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39eed270 >2013-12-09 09:28:20,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39eed270 >2013-12-09 09:28:25,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 388bc762 >2013-12-09 09:28:25,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 388bc762 >2013-12-09 09:28:25,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 202a651 >2013-12-09 09:28:25,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 202a651 >2013-12-09 09:28:30,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36b893b0 >2013-12-09 09:28:31,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 36b893b0 >2013-12-09 09:28:31,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79476e6e >2013-12-09 09:28:31,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79476e6e >2013-12-09 09:28:36,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5fd846c2 >2013-12-09 09:28:37,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5fd846c2 >2013-12-09 09:28:37,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11063276 >2013-12-09 09:28:37,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11063276 >2013-12-09 09:28:37,853 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-59) No up server in cluster >2013-12-09 09:28:37,853 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-59) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:28:37,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7cb390e1 >2013-12-09 09:28:38,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7cb390e1 >2013-12-09 09:28:42,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 434488f4 >2013-12-09 09:28:42,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 434488f4 >2013-12-09 09:28:42,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ba5b865 >2013-12-09 09:28:43,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ba5b865 >2013-12-09 09:28:48,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d701ca >2013-12-09 09:28:48,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6d701ca >2013-12-09 09:28:48,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c7f5920 >2013-12-09 09:28:48,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c7f5920 >2013-12-09 09:28:53,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41677205 >2013-12-09 09:28:54,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 41677205 >2013-12-09 09:28:54,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 653b5a3e >2013-12-09 09:28:54,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 653b5a3e >2013-12-09 09:28:59,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ba1f5ba >2013-12-09 09:29:00,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ba1f5ba >2013-12-09 09:29:00,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73954b4b >2013-12-09 09:29:00,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73954b4b >2013-12-09 09:29:05,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54119914 >2013-12-09 09:29:06,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 54119914 >2013-12-09 09:29:06,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b1370b4 >2013-12-09 09:29:06,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b1370b4 >2013-12-09 09:29:11,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b33124f >2013-12-09 09:29:11,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b33124f >2013-12-09 09:29:11,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c89487f >2013-12-09 09:29:12,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c89487f >2013-12-09 09:29:17,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 742a8264 >2013-12-09 09:29:17,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 742a8264 >2013-12-09 09:29:17,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3bcd9315 >2013-12-09 09:29:17,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3bcd9315 >2013-12-09 09:29:22,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72c985da >2013-12-09 09:29:23,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 72c985da >2013-12-09 09:29:23,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2da71b12 >2013-12-09 09:29:23,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2da71b12 >2013-12-09 09:29:28,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70137b46 >2013-12-09 09:29:29,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 70137b46 >2013-12-09 09:29:29,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 438cc7ad >2013-12-09 09:29:29,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 438cc7ad >2013-12-09 09:29:34,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 480a4ab2 >2013-12-09 09:29:34,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 480a4ab2 >2013-12-09 09:29:34,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 590c4c07 >2013-12-09 09:29:35,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 590c4c07 >2013-12-09 09:29:38,136 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-38) No up server in cluster >2013-12-09 09:29:38,136 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-38) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:29:38,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 638e01af >2013-12-09 09:29:38,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterTasksListVDSCommand, return: [], log id: 638e01af >2013-12-09 09:29:40,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b3483ba >2013-12-09 09:29:40,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b3483ba >2013-12-09 09:29:40,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d2b38d6 >2013-12-09 09:29:40,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d2b38d6 >2013-12-09 09:29:45,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b3fc613 >2013-12-09 09:29:46,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b3fc613 >2013-12-09 09:29:46,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18bb623 >2013-12-09 09:29:46,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18bb623 >2013-12-09 09:29:51,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75d1b55c >2013-12-09 09:29:52,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 75d1b55c >2013-12-09 09:29:52,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17f8ebee >2013-12-09 09:29:52,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17f8ebee >2013-12-09 09:29:57,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 312ce970 >2013-12-09 09:29:57,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 312ce970 >2013-12-09 09:29:57,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47debae8 >2013-12-09 09:29:58,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47debae8 >2013-12-09 09:30:03,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1160d152 >2013-12-09 09:30:03,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1160d152 >2013-12-09 09:30:03,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42a84e6 >2013-12-09 09:30:04,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42a84e6 >2013-12-09 09:30:09,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32d48c00 >2013-12-09 09:30:09,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 32d48c00 >2013-12-09 09:30:09,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ba0d830 >2013-12-09 09:30:09,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ba0d830 >2013-12-09 09:30:14,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2af3f912 >2013-12-09 09:30:15,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2af3f912 >2013-12-09 09:30:15,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50f40e01 >2013-12-09 09:30:15,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50f40e01 >2013-12-09 09:30:20,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 480f91a2 >2013-12-09 09:30:21,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 480f91a2 >2013-12-09 09:30:21,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4818257d >2013-12-09 09:30:21,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4818257d >2013-12-09 09:30:26,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a783582 >2013-12-09 09:30:26,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4a783582 >2013-12-09 09:30:26,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: be0f005 >2013-12-09 09:30:27,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: be0f005 >2013-12-09 09:30:32,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12fd778f >2013-12-09 09:30:32,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 12fd778f >2013-12-09 09:30:32,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6aea7078 >2013-12-09 09:30:32,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6aea7078 >2013-12-09 09:30:37,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 293fc087 >2013-12-09 09:30:38,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 293fc087 >2013-12-09 09:30:38,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b89190 >2013-12-09 09:30:38,421 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-49) No up server in cluster >2013-12-09 09:30:38,421 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-49) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:30:38,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71bee255 >2013-12-09 09:30:38,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b89190 >2013-12-09 09:30:38,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterTasksListVDSCommand, return: [], log id: 71bee255 >2013-12-09 09:30:43,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8e17f35 >2013-12-09 09:30:44,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 8e17f35 >2013-12-09 09:30:44,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b111c6b >2013-12-09 09:30:44,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b111c6b >2013-12-09 09:30:49,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a416c9a >2013-12-09 09:30:49,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: a416c9a >2013-12-09 09:30:49,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d9e0974 >2013-12-09 09:30:50,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d9e0974 >2013-12-09 09:30:55,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a1bb0bb >2013-12-09 09:30:55,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2a1bb0bb >2013-12-09 09:30:55,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 653ec771 >2013-12-09 09:30:55,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 653ec771 >2013-12-09 09:31:01,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58668b2 >2013-12-09 09:31:01,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 58668b2 >2013-12-09 09:31:01,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2386d04a >2013-12-09 09:31:01,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2386d04a >2013-12-09 09:31:06,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b8ad370 >2013-12-09 09:31:07,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b8ad370 >2013-12-09 09:31:07,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f76b521 >2013-12-09 09:31:07,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f76b521 >2013-12-09 09:31:12,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 573a32b1 >2013-12-09 09:31:13,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 573a32b1 >2013-12-09 09:31:13,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 482cc9b3 >2013-12-09 09:31:13,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 482cc9b3 >2013-12-09 09:31:18,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 105a2bf3 >2013-12-09 09:31:18,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 105a2bf3 >2013-12-09 09:31:18,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fc3cd07 >2013-12-09 09:31:19,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fc3cd07 >2013-12-09 09:31:24,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f728c4c >2013-12-09 09:31:24,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3f728c4c >2013-12-09 09:31:24,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39c06aa3 >2013-12-09 09:31:24,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39c06aa3 >2013-12-09 09:31:29,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35ad58fd >2013-12-09 09:31:30,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 35ad58fd >2013-12-09 09:31:30,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69ef51de >2013-12-09 09:31:30,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69ef51de >2013-12-09 09:31:35,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27c5aa3f >2013-12-09 09:31:36,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 27c5aa3f >2013-12-09 09:31:36,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f39463 >2013-12-09 09:31:36,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f39463 >2013-12-09 09:31:38,688 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-7) No up server in cluster >2013-12-09 09:31:38,688 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-7) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:31:38,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f42baeb >2013-12-09 09:31:38,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5f42baeb >2013-12-09 09:31:41,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d535d91 >2013-12-09 09:31:41,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6d535d91 >2013-12-09 09:31:41,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c319f80 >2013-12-09 09:31:42,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c319f80 >2013-12-09 09:31:47,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3eda77a1 >2013-12-09 09:31:47,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3eda77a1 >2013-12-09 09:31:47,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67824ab >2013-12-09 09:31:47,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67824ab >2013-12-09 09:31:52,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c29fd06 >2013-12-09 09:31:53,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c29fd06 >2013-12-09 09:31:53,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3dcbd23e >2013-12-09 09:31:53,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3dcbd23e >2013-12-09 09:31:58,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41bc1931 >2013-12-09 09:31:59,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 41bc1931 >2013-12-09 09:31:59,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5dcd725e >2013-12-09 09:31:59,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5dcd725e >2013-12-09 09:32:04,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d5002d8 >2013-12-09 09:32:05,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d5002d8 >2013-12-09 09:32:05,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62b42f43 >2013-12-09 09:32:05,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62b42f43 >2013-12-09 09:32:10,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b32fcd5 >2013-12-09 09:32:11,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b32fcd5 >2013-12-09 09:32:11,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 163b8dd6 >2013-12-09 09:32:11,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 163b8dd6 >2013-12-09 09:32:16,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31948abd >2013-12-09 09:32:16,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 31948abd >2013-12-09 09:32:16,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ac89125 >2013-12-09 09:32:17,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ac89125 >2013-12-09 09:32:22,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40d728fa >2013-12-09 09:32:22,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 40d728fa >2013-12-09 09:32:22,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 333f5060 >2013-12-09 09:32:22,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 333f5060 >2013-12-09 09:32:27,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 620d7b8c >2013-12-09 09:32:28,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 620d7b8c >2013-12-09 09:32:28,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4952868a >2013-12-09 09:32:28,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4952868a >2013-12-09 09:32:33,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19689146 >2013-12-09 09:32:34,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19689146 >2013-12-09 09:32:34,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f44d7f2 >2013-12-09 09:32:34,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f44d7f2 >2013-12-09 09:32:38,967 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-26) No up server in cluster >2013-12-09 09:32:38,967 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-26) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:32:38,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 411a7fe5 >2013-12-09 09:32:39,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterTasksListVDSCommand, return: [], log id: 411a7fe5 >2013-12-09 09:32:39,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d7c0e12 >2013-12-09 09:32:39,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2d7c0e12 >2013-12-09 09:32:39,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20fadc7a >2013-12-09 09:32:40,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20fadc7a >2013-12-09 09:32:45,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6800ee25 >2013-12-09 09:32:45,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6800ee25 >2013-12-09 09:32:45,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2bc05a95 >2013-12-09 09:32:46,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bc05a95 >2013-12-09 09:32:51,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ab3458a >2013-12-09 09:32:51,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1ab3458a >2013-12-09 09:32:51,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f3d424c >2013-12-09 09:32:51,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f3d424c >2013-12-09 09:32:56,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f7b1e6b >2013-12-09 09:32:57,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f7b1e6b >2013-12-09 09:32:57,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7963a057 >2013-12-09 09:32:57,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7963a057 >2013-12-09 09:33:02,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b62c1a5 >2013-12-09 09:33:03,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4b62c1a5 >2013-12-09 09:33:03,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15351946 >2013-12-09 09:33:03,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15351946 >2013-12-09 09:33:08,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5faf72f8 >2013-12-09 09:33:08,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5faf72f8 >2013-12-09 09:33:08,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4de12d7d >2013-12-09 09:33:09,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4de12d7d >2013-12-09 09:33:14,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c60a269 >2013-12-09 09:33:14,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6c60a269 >2013-12-09 09:33:14,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b2b3407 >2013-12-09 09:33:14,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b2b3407 >2013-12-09 09:33:19,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3abd4169 >2013-12-09 09:33:20,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3abd4169 >2013-12-09 09:33:20,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d1d87da >2013-12-09 09:33:20,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d1d87da >2013-12-09 09:33:25,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5698977a >2013-12-09 09:33:26,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5698977a >2013-12-09 09:33:26,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f5c4af0 >2013-12-09 09:33:26,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f5c4af0 >2013-12-09 09:33:31,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 14d3c5b2 >2013-12-09 09:33:32,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 14d3c5b2 >2013-12-09 09:33:32,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 408f5442 >2013-12-09 09:33:32,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 408f5442 >2013-12-09 09:33:37,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e85db5f >2013-12-09 09:33:37,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e85db5f >2013-12-09 09:33:37,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e9949c7 >2013-12-09 09:33:38,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e9949c7 >2013-12-09 09:33:39,239 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-11) No up server in cluster >2013-12-09 09:33:39,239 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-11) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:33:39,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10d9435c >2013-12-09 09:33:39,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterTasksListVDSCommand, return: [], log id: 10d9435c >2013-12-09 09:33:43,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 139ee23b >2013-12-09 09:33:43,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 139ee23b >2013-12-09 09:33:43,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37185e4f >2013-12-09 09:33:43,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37185e4f >2013-12-09 09:33:48,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77d4365 >2013-12-09 09:33:49,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 77d4365 >2013-12-09 09:33:49,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d1d106c >2013-12-09 09:33:49,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d1d106c >2013-12-09 09:33:54,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c95b7dd >2013-12-09 09:33:55,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c95b7dd >2013-12-09 09:33:55,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a4de86a >2013-12-09 09:33:55,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a4de86a >2013-12-09 09:34:00,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3532fb98 >2013-12-09 09:34:00,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3532fb98 >2013-12-09 09:34:00,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 535d9dbb >2013-12-09 09:34:01,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 535d9dbb >2013-12-09 09:34:06,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a897dad >2013-12-09 09:34:06,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a897dad >2013-12-09 09:34:06,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 313f002 >2013-12-09 09:34:07,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 313f002 >2013-12-09 09:34:12,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55e03571 >2013-12-09 09:34:12,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 55e03571 >2013-12-09 09:34:12,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68ee52d3 >2013-12-09 09:34:12,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68ee52d3 >2013-12-09 09:34:17,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f13bc4b >2013-12-09 09:34:18,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f13bc4b >2013-12-09 09:34:18,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ed67b8e >2013-12-09 09:34:18,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ed67b8e >2013-12-09 09:34:23,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c22b842 >2013-12-09 09:34:24,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4c22b842 >2013-12-09 09:34:24,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70c44a32 >2013-12-09 09:34:24,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70c44a32 >2013-12-09 09:34:29,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a062fd6 >2013-12-09 09:34:29,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3a062fd6 >2013-12-09 09:34:29,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61efd5b7 >2013-12-09 09:34:30,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61efd5b7 >2013-12-09 09:34:35,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 15328ebf >2013-12-09 09:34:35,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 15328ebf >2013-12-09 09:34:35,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 799c15a5 >2013-12-09 09:34:35,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 799c15a5 >2013-12-09 09:34:39,520 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-93) No up server in cluster >2013-12-09 09:34:39,520 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-93) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:34:39,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37f91080 >2013-12-09 09:34:39,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterTasksListVDSCommand, return: [], log id: 37f91080 >2013-12-09 09:34:40,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d9ebd59 >2013-12-09 09:34:41,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: d9ebd59 >2013-12-09 09:34:41,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c735fa5 >2013-12-09 09:34:41,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c735fa5 >2013-12-09 09:34:46,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33f9da74 >2013-12-09 09:34:47,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 33f9da74 >2013-12-09 09:34:47,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 789665d9 >2013-12-09 09:34:47,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 789665d9 >2013-12-09 09:34:52,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66629fde >2013-12-09 09:34:52,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 66629fde >2013-12-09 09:34:52,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37ca06fe >2013-12-09 09:34:53,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37ca06fe >2013-12-09 09:34:58,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c0c4a32 >2013-12-09 09:34:58,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6c0c4a32 >2013-12-09 09:34:58,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17030870 >2013-12-09 09:34:58,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17030870 >2013-12-09 09:35:03,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 14be90e9 >2013-12-09 09:35:04,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 14be90e9 >2013-12-09 09:35:04,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f3cf9a9 >2013-12-09 09:35:04,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f3cf9a9 >2013-12-09 09:35:09,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19c2e16c >2013-12-09 09:35:10,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19c2e16c >2013-12-09 09:35:10,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67ad9d >2013-12-09 09:35:10,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67ad9d >2013-12-09 09:35:15,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10d24671 >2013-12-09 09:35:16,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 10d24671 >2013-12-09 09:35:16,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f75ff75 >2013-12-09 09:35:16,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f75ff75 >2013-12-09 09:35:21,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c005956 >2013-12-09 09:35:21,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c005956 >2013-12-09 09:35:21,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62bd7cf0 >2013-12-09 09:35:22,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62bd7cf0 >2013-12-09 09:35:27,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8733610 >2013-12-09 09:35:27,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 8733610 >2013-12-09 09:35:27,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71a572f8 >2013-12-09 09:35:27,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71a572f8 >2013-12-09 09:35:32,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55887ce5 >2013-12-09 09:35:33,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 55887ce5 >2013-12-09 09:35:33,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21a7a2be >2013-12-09 09:35:33,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21a7a2be >2013-12-09 09:35:38,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37f17c24 >2013-12-09 09:35:39,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 37f17c24 >2013-12-09 09:35:39,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10ed1786 >2013-12-09 09:35:39,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10ed1786 >2013-12-09 09:35:39,788 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-28) No up server in cluster >2013-12-09 09:35:39,788 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-28) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:35:39,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13148d81 >2013-12-09 09:35:40,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterTasksListVDSCommand, return: [], log id: 13148d81 >2013-12-09 09:35:44,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17b91832 >2013-12-09 09:35:44,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 17b91832 >2013-12-09 09:35:44,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4208b8ef >2013-12-09 09:35:45,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4208b8ef >2013-12-09 09:35:50,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 754b898a >2013-12-09 09:35:50,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 754b898a >2013-12-09 09:35:50,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d8d1daa >2013-12-09 09:35:50,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d8d1daa >2013-12-09 09:35:55,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20d6ec59 >2013-12-09 09:35:56,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 20d6ec59 >2013-12-09 09:35:56,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f99e670 >2013-12-09 09:35:56,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f99e670 >2013-12-09 09:36:01,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d821c27 >2013-12-09 09:36:02,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d821c27 >2013-12-09 09:36:02,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65c453cd >2013-12-09 09:36:02,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65c453cd >2013-12-09 09:36:07,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e86bd1d >2013-12-09 09:36:07,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: e86bd1d >2013-12-09 09:36:07,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28a336a9 >2013-12-09 09:36:08,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28a336a9 >2013-12-09 09:36:13,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73a06757 >2013-12-09 09:36:13,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 73a06757 >2013-12-09 09:36:13,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59abbaa5 >2013-12-09 09:36:13,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59abbaa5 >2013-12-09 09:36:18,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3462bd6 >2013-12-09 09:36:19,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3462bd6 >2013-12-09 09:36:19,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26f1f623 >2013-12-09 09:36:19,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26f1f623 >2013-12-09 09:36:24,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7aed5bff >2013-12-09 09:36:25,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7aed5bff >2013-12-09 09:36:25,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a16d77a >2013-12-09 09:36:25,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a16d77a >2013-12-09 09:36:30,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 374d5b48 >2013-12-09 09:36:31,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 374d5b48 >2013-12-09 09:36:31,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d825c7d >2013-12-09 09:36:31,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d825c7d >2013-12-09 09:36:36,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2abff0eb >2013-12-09 09:36:36,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2abff0eb >2013-12-09 09:36:36,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24ca76a9 >2013-12-09 09:36:37,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24ca76a9 >2013-12-09 09:36:40,073 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-63) No up server in cluster >2013-12-09 09:36:40,073 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-63) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:36:40,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e522d4e >2013-12-09 09:36:40,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5e522d4e >2013-12-09 09:36:42,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18f4ced0 >2013-12-09 09:36:42,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 18f4ced0 >2013-12-09 09:36:42,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19710755 >2013-12-09 09:36:42,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19710755 >2013-12-09 09:36:47,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65fec66a >2013-12-09 09:36:48,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 65fec66a >2013-12-09 09:36:48,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7aab1025 >2013-12-09 09:36:48,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7aab1025 >2013-12-09 09:36:53,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e7d4a0 >2013-12-09 09:36:54,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e7d4a0 >2013-12-09 09:36:54,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c47057d >2013-12-09 09:36:54,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c47057d >2013-12-09 09:36:59,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1abf93ae >2013-12-09 09:37:00,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1abf93ae >2013-12-09 09:37:00,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2bce25e7 >2013-12-09 09:37:00,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bce25e7 >2013-12-09 09:37:05,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1665bdfa >2013-12-09 09:37:05,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1665bdfa >2013-12-09 09:37:05,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 777ef604 >2013-12-09 09:37:06,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 777ef604 >2013-12-09 09:37:11,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 675f247c >2013-12-09 09:37:11,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 675f247c >2013-12-09 09:37:11,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13a031b8 >2013-12-09 09:37:12,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13a031b8 >2013-12-09 09:37:17,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3257604d >2013-12-09 09:37:17,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3257604d >2013-12-09 09:37:17,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d2ae855 >2013-12-09 09:37:17,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d2ae855 >2013-12-09 09:37:22,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 520e0f35 >2013-12-09 09:37:23,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 520e0f35 >2013-12-09 09:37:23,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 141d9dda >2013-12-09 09:37:23,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 141d9dda >2013-12-09 09:37:28,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e256996 >2013-12-09 09:37:29,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7e256996 >2013-12-09 09:37:29,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ae78674 >2013-12-09 09:37:29,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ae78674 >2013-12-09 09:37:34,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34fa4945 >2013-12-09 09:37:34,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 34fa4945 >2013-12-09 09:37:34,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d25b055 >2013-12-09 09:37:35,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d25b055 >2013-12-09 09:37:40,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f259083 >2013-12-09 09:37:40,346 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-91) No up server in cluster >2013-12-09 09:37:40,347 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-91) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:37:40,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ec443c2 >2013-12-09 09:37:40,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1ec443c2 >2013-12-09 09:37:40,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f259083 >2013-12-09 09:37:40,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b239943 >2013-12-09 09:37:40,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b239943 >2013-12-09 09:37:45,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38b3c70a >2013-12-09 09:37:46,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 38b3c70a >2013-12-09 09:37:46,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a96d14c >2013-12-09 09:37:46,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a96d14c >2013-12-09 09:37:51,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58fa2c05 >2013-12-09 09:37:52,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 58fa2c05 >2013-12-09 09:37:52,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 203a9980 >2013-12-09 09:37:52,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 203a9980 >2013-12-09 09:37:57,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 355ea796 >2013-12-09 09:37:57,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 355ea796 >2013-12-09 09:37:57,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f2eaae0 >2013-12-09 09:37:58,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f2eaae0 >2013-12-09 09:38:03,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d4b2a6c >2013-12-09 09:38:03,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: d4b2a6c >2013-12-09 09:38:03,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19186686 >2013-12-09 09:38:04,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19186686 >2013-12-09 09:38:09,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57eb6640 >2013-12-09 09:38:09,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 57eb6640 >2013-12-09 09:38:09,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72cb05cd >2013-12-09 09:38:09,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72cb05cd >2013-12-09 09:38:14,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2eb1004b >2013-12-09 09:38:15,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2eb1004b >2013-12-09 09:38:15,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7eea52f >2013-12-09 09:38:15,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7eea52f >2013-12-09 09:38:20,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 742d4953 >2013-12-09 09:38:21,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 742d4953 >2013-12-09 09:38:21,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21875210 >2013-12-09 09:38:21,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21875210 >2013-12-09 09:38:26,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d7a75c2 >2013-12-09 09:38:26,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5d7a75c2 >2013-12-09 09:38:26,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 117e937b >2013-12-09 09:38:27,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 117e937b >2013-12-09 09:38:32,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 703b4c0e >2013-12-09 09:38:32,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 703b4c0e >2013-12-09 09:38:32,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52e508aa >2013-12-09 09:38:32,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52e508aa >2013-12-09 09:38:37,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f9f861d >2013-12-09 09:38:38,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f9f861d >2013-12-09 09:38:38,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f5e625d >2013-12-09 09:38:38,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f5e625d >2013-12-09 09:38:40,621 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-1) No up server in cluster >2013-12-09 09:38:40,621 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-1) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:38:40,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76b732a8 >2013-12-09 09:38:40,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterTasksListVDSCommand, return: [], log id: 76b732a8 >2013-12-09 09:38:43,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5459f3db >2013-12-09 09:38:44,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5459f3db >2013-12-09 09:38:44,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b017bab >2013-12-09 09:38:44,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b017bab >2013-12-09 09:38:49,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16df14bf >2013-12-09 09:38:49,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 16df14bf >2013-12-09 09:38:49,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 628ed54 >2013-12-09 09:38:50,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 628ed54 >2013-12-09 09:38:55,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e0686aa >2013-12-09 09:38:55,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6e0686aa >2013-12-09 09:38:55,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63d03663 >2013-12-09 09:38:56,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63d03663 >2013-12-09 09:39:01,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 438f5fad >2013-12-09 09:39:01,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 438f5fad >2013-12-09 09:39:01,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5cb81132 >2013-12-09 09:39:01,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cb81132 >2013-12-09 09:39:06,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36831b1d >2013-12-09 09:39:07,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 36831b1d >2013-12-09 09:39:07,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ba79cf >2013-12-09 09:39:07,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ba79cf >2013-12-09 09:39:12,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 510dc878 >2013-12-09 09:39:13,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 510dc878 >2013-12-09 09:39:13,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 709a230e >2013-12-09 09:39:13,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 709a230e >2013-12-09 09:39:18,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65dfb9a >2013-12-09 09:39:18,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 65dfb9a >2013-12-09 09:39:18,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2cce9ddc >2013-12-09 09:39:19,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2cce9ddc >2013-12-09 09:39:24,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b7e3436 >2013-12-09 09:39:24,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b7e3436 >2013-12-09 09:39:24,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64111b67 >2013-12-09 09:39:25,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64111b67 >2013-12-09 09:39:30,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b470b43 >2013-12-09 09:39:30,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: b470b43 >2013-12-09 09:39:30,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6701ef06 >2013-12-09 09:39:30,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6701ef06 >2013-12-09 09:39:35,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1acccf2a >2013-12-09 09:39:36,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1acccf2a >2013-12-09 09:39:36,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18cbb78b >2013-12-09 09:39:36,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18cbb78b >2013-12-09 09:39:40,909 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-80) No up server in cluster >2013-12-09 09:39:40,909 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-80) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:39:40,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14bf55b7 >2013-12-09 09:39:41,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterTasksListVDSCommand, return: [], log id: 14bf55b7 >2013-12-09 09:39:41,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71321c2f >2013-12-09 09:39:42,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 71321c2f >2013-12-09 09:39:42,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 473a91c7 >2013-12-09 09:39:42,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 473a91c7 >2013-12-09 09:39:47,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19af045e >2013-12-09 09:39:47,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19af045e >2013-12-09 09:39:47,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: bef6770 >2013-12-09 09:39:48,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: bef6770 >2013-12-09 09:39:53,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56391ead >2013-12-09 09:39:53,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 56391ead >2013-12-09 09:39:53,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 361484a3 >2013-12-09 09:39:53,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 361484a3 >2013-12-09 09:39:58,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e1fdf5c >2013-12-09 09:39:59,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1e1fdf5c >2013-12-09 09:39:59,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62bda2d >2013-12-09 09:39:59,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62bda2d >2013-12-09 09:40:04,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e6529b2 >2013-12-09 09:40:05,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1e6529b2 >2013-12-09 09:40:05,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 498551f0 >2013-12-09 09:40:05,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 498551f0 >2013-12-09 09:40:10,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ec87300 >2013-12-09 09:40:10,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ec87300 >2013-12-09 09:40:10,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 521bfad9 >2013-12-09 09:40:11,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 521bfad9 >2013-12-09 09:40:16,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7784b073 >2013-12-09 09:40:16,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7784b073 >2013-12-09 09:40:16,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 179a414d >2013-12-09 09:40:16,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 179a414d >2013-12-09 09:40:21,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 275fbef9 >2013-12-09 09:40:22,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 275fbef9 >2013-12-09 09:40:22,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1219cc70 >2013-12-09 09:40:22,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1219cc70 >2013-12-09 09:40:27,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e2c5179 >2013-12-09 09:40:28,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e2c5179 >2013-12-09 09:40:28,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 515242ef >2013-12-09 09:40:28,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 515242ef >2013-12-09 09:40:33,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b6a37ba >2013-12-09 09:40:34,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: b6a37ba >2013-12-09 09:40:34,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ba50b3a >2013-12-09 09:40:34,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ba50b3a >2013-12-09 09:40:39,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66cabbb6 >2013-12-09 09:40:39,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 66cabbb6 >2013-12-09 09:40:39,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50957f76 >2013-12-09 09:40:40,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50957f76 >2013-12-09 09:40:41,186 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-69) No up server in cluster >2013-12-09 09:40:41,186 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-69) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:40:41,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5357106a >2013-12-09 09:40:41,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5357106a >2013-12-09 09:40:45,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6fb51bba >2013-12-09 09:40:45,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6fb51bba >2013-12-09 09:40:45,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f79c286 >2013-12-09 09:40:45,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f79c286 >2013-12-09 09:40:50,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 118e63c7 >2013-12-09 09:40:51,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 118e63c7 >2013-12-09 09:40:51,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e47fea4 >2013-12-09 09:40:51,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e47fea4 >2013-12-09 09:40:56,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51c83ee4 >2013-12-09 09:40:57,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 51c83ee4 >2013-12-09 09:40:57,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 338f5b92 >2013-12-09 09:40:57,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 338f5b92 >2013-12-09 09:41:02,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57a6706e >2013-12-09 09:41:02,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 57a6706e >2013-12-09 09:41:02,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4fb8c8e4 >2013-12-09 09:41:03,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fb8c8e4 >2013-12-09 09:41:08,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 354a1051 >2013-12-09 09:41:08,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 354a1051 >2013-12-09 09:41:08,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ddbc4d >2013-12-09 09:41:09,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ddbc4d >2013-12-09 09:41:14,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3dcdceae >2013-12-09 09:41:14,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3dcdceae >2013-12-09 09:41:14,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a82d440 >2013-12-09 09:41:14,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a82d440 >2013-12-09 09:41:19,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c0ec6cd >2013-12-09 09:41:20,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: c0ec6cd >2013-12-09 09:41:20,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b8793ca >2013-12-09 09:41:20,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b8793ca >2013-12-09 09:41:25,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 378f044d >2013-12-09 09:41:26,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 378f044d >2013-12-09 09:41:26,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3257a644 >2013-12-09 09:41:26,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3257a644 >2013-12-09 09:41:31,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29ee1822 >2013-12-09 09:41:31,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 29ee1822 >2013-12-09 09:41:31,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ff6df21 >2013-12-09 09:41:32,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ff6df21 >2013-12-09 09:41:37,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64249c0e >2013-12-09 09:41:37,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 64249c0e >2013-12-09 09:41:37,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a058391 >2013-12-09 09:41:37,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a058391 >2013-12-09 09:41:41,457 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-67) No up server in cluster >2013-12-09 09:41:41,458 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-67) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:41:41,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18b1771b >2013-12-09 09:41:41,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterTasksListVDSCommand, return: [], log id: 18b1771b >2013-12-09 09:41:42,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51c0894d >2013-12-09 09:41:43,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 51c0894d >2013-12-09 09:41:43,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 25cc413e >2013-12-09 09:41:43,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25cc413e >2013-12-09 09:41:48,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24bf0724 >2013-12-09 09:41:49,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 24bf0724 >2013-12-09 09:41:49,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7afa6474 >2013-12-09 09:41:49,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7afa6474 >2013-12-09 09:41:54,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d6abd37 >2013-12-09 09:41:54,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d6abd37 >2013-12-09 09:41:54,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 639cb55a >2013-12-09 09:41:55,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 639cb55a >2013-12-09 09:42:00,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53a568cc >2013-12-09 09:42:00,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 53a568cc >2013-12-09 09:42:00,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 342ab88 >2013-12-09 09:42:01,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 342ab88 >2013-12-09 09:42:06,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2889ff66 >2013-12-09 09:42:06,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2889ff66 >2013-12-09 09:42:06,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6bba74b >2013-12-09 09:42:06,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6bba74b >2013-12-09 09:42:11,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2230ede4 >2013-12-09 09:42:12,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2230ede4 >2013-12-09 09:42:12,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 758270c9 >2013-12-09 09:42:12,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 758270c9 >2013-12-09 09:42:17,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f1be61b >2013-12-09 09:42:18,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5f1be61b >2013-12-09 09:42:18,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6fd25e42 >2013-12-09 09:42:18,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6fd25e42 >2013-12-09 09:42:23,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f3e0b7e >2013-12-09 09:42:23,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5f3e0b7e >2013-12-09 09:42:23,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f765352 >2013-12-09 09:42:24,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f765352 >2013-12-09 09:42:29,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f9adbe9 >2013-12-09 09:42:29,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f9adbe9 >2013-12-09 09:42:29,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ed267a8 >2013-12-09 09:42:30,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ed267a8 >2013-12-09 09:42:35,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61c41690 >2013-12-09 09:42:35,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 61c41690 >2013-12-09 09:42:35,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37f69cd0 >2013-12-09 09:42:35,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37f69cd0 >2013-12-09 09:42:40,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77034b6e >2013-12-09 09:42:41,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 77034b6e >2013-12-09 09:42:41,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ce0f86f >2013-12-09 09:42:41,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ce0f86f >2013-12-09 09:42:41,725 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-95) No up server in cluster >2013-12-09 09:42:41,725 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-95) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:42:41,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55e71c6b >2013-12-09 09:42:42,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterTasksListVDSCommand, return: [], log id: 55e71c6b >2013-12-09 09:42:46,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6bbce415 >2013-12-09 09:42:47,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6bbce415 >2013-12-09 09:42:47,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7fb4333e >2013-12-09 09:42:47,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fb4333e >2013-12-09 09:42:52,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64fb98b >2013-12-09 09:42:52,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 64fb98b >2013-12-09 09:42:52,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 962da82 >2013-12-09 09:42:53,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 962da82 >2013-12-09 09:42:58,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 180cec6a >2013-12-09 09:42:58,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 180cec6a >2013-12-09 09:42:58,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ff7990a >2013-12-09 09:42:58,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ff7990a >2013-12-09 09:43:03,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10d03dd3 >2013-12-09 09:43:04,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 10d03dd3 >2013-12-09 09:43:04,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f7d0951 >2013-12-09 09:43:04,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f7d0951 >2013-12-09 09:43:09,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 562dd7c >2013-12-09 09:43:10,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 562dd7c >2013-12-09 09:43:10,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36ab5f0f >2013-12-09 09:43:10,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36ab5f0f >2013-12-09 09:43:15,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 458199a7 >2013-12-09 09:43:16,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 458199a7 >2013-12-09 09:43:16,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f556077 >2013-12-09 09:43:16,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f556077 >2013-12-09 09:43:21,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31dad00a >2013-12-09 09:43:21,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 31dad00a >2013-12-09 09:43:21,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3306fc4e >2013-12-09 09:43:22,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3306fc4e >2013-12-09 09:43:27,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 650837c4 >2013-12-09 09:43:27,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 650837c4 >2013-12-09 09:43:27,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51874c21 >2013-12-09 09:43:27,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51874c21 >2013-12-09 09:43:32,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3da77c86 >2013-12-09 09:43:33,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3da77c86 >2013-12-09 09:43:33,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2098d7ad >2013-12-09 09:43:33,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2098d7ad >2013-12-09 09:43:38,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6cc63753 >2013-12-09 09:43:39,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6cc63753 >2013-12-09 09:43:39,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c539905 >2013-12-09 09:43:39,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c539905 >2013-12-09 09:43:42,009 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-70) No up server in cluster >2013-12-09 09:43:42,009 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-70) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:43:42,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42a5d48a >2013-12-09 09:43:42,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterTasksListVDSCommand, return: [], log id: 42a5d48a >2013-12-09 09:43:44,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 25e31bb8 >2013-12-09 09:43:45,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 25e31bb8 >2013-12-09 09:43:45,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f07e65e >2013-12-09 09:43:45,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f07e65e >2013-12-09 09:43:50,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 430176e0 >2013-12-09 09:43:50,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 430176e0 >2013-12-09 09:43:50,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 336d7a05 >2013-12-09 09:43:51,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 336d7a05 >2013-12-09 09:43:56,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f0464e5 >2013-12-09 09:43:56,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f0464e5 >2013-12-09 09:43:56,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 778c41e3 >2013-12-09 09:43:56,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 778c41e3 >2013-12-09 09:44:01,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67a5f801 >2013-12-09 09:44:02,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 67a5f801 >2013-12-09 09:44:02,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 423fed9a >2013-12-09 09:44:02,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 423fed9a >2013-12-09 09:44:07,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69a87759 >2013-12-09 09:44:08,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 69a87759 >2013-12-09 09:44:08,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 204f4c20 >2013-12-09 09:44:08,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 204f4c20 >2013-12-09 09:44:13,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41f37ffd >2013-12-09 09:44:13,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 41f37ffd >2013-12-09 09:44:13,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7af65649 >2013-12-09 09:44:14,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7af65649 >2013-12-09 09:44:19,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b4bc54d >2013-12-09 09:44:19,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b4bc54d >2013-12-09 09:44:19,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a88f9bd >2013-12-09 09:44:19,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a88f9bd >2013-12-09 09:44:24,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a14373c >2013-12-09 09:44:25,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2a14373c >2013-12-09 09:44:25,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72eeaefd >2013-12-09 09:44:25,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72eeaefd >2013-12-09 09:44:30,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4706c51a >2013-12-09 09:44:31,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4706c51a >2013-12-09 09:44:31,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e46f986 >2013-12-09 09:44:31,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e46f986 >2013-12-09 09:44:36,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6dcd35bd >2013-12-09 09:44:37,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6dcd35bd >2013-12-09 09:44:37,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a4f4b0d >2013-12-09 09:44:37,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a4f4b0d >2013-12-09 09:44:42,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: bac1a0c >2013-12-09 09:44:42,289 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-4) No up server in cluster >2013-12-09 09:44:42,289 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-4) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:44:42,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 740218dd >2013-12-09 09:44:42,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterTasksListVDSCommand, return: [], log id: 740218dd >2013-12-09 09:44:42,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: bac1a0c >2013-12-09 09:44:42,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19439c9 >2013-12-09 09:44:43,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19439c9 >2013-12-09 09:44:48,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5882c3fd >2013-12-09 09:44:48,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5882c3fd >2013-12-09 09:44:48,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2633e3d3 >2013-12-09 09:44:48,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2633e3d3 >2013-12-09 09:44:53,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 392f0402 >2013-12-09 09:44:54,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 392f0402 >2013-12-09 09:44:54,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23ef387d >2013-12-09 09:44:54,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23ef387d >2013-12-09 09:44:59,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28ec017f >2013-12-09 09:45:00,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 28ec017f >2013-12-09 09:45:00,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1326d7a8 >2013-12-09 09:45:00,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1326d7a8 >2013-12-09 09:45:05,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f687b57 >2013-12-09 09:45:05,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5f687b57 >2013-12-09 09:45:05,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2243d8e9 >2013-12-09 09:45:06,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2243d8e9 >2013-12-09 09:45:11,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9b78556 >2013-12-09 09:45:11,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 9b78556 >2013-12-09 09:45:11,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3875844a >2013-12-09 09:45:11,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3875844a >2013-12-09 09:45:16,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37d9dddc >2013-12-09 09:45:17,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 37d9dddc >2013-12-09 09:45:17,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65d74646 >2013-12-09 09:45:17,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65d74646 >2013-12-09 09:45:22,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1114a8c8 >2013-12-09 09:45:23,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1114a8c8 >2013-12-09 09:45:23,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a03e4a1 >2013-12-09 09:45:23,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a03e4a1 >2013-12-09 09:45:28,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57c2902c >2013-12-09 09:45:29,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 57c2902c >2013-12-09 09:45:29,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11fd6381 >2013-12-09 09:45:29,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11fd6381 >2013-12-09 09:45:34,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41e457be >2013-12-09 09:45:34,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 41e457be >2013-12-09 09:45:34,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 232f00e7 >2013-12-09 09:45:35,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 232f00e7 >2013-12-09 09:45:40,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b130c09 >2013-12-09 09:45:40,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b130c09 >2013-12-09 09:45:40,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3263db29 >2013-12-09 09:45:40,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3263db29 >2013-12-09 09:45:42,554 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-77) No up server in cluster >2013-12-09 09:45:42,555 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-77) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:45:42,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58e3dba6 >2013-12-09 09:45:42,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterTasksListVDSCommand, return: [], log id: 58e3dba6 >2013-12-09 09:45:45,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ab5235c >2013-12-09 09:45:46,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ab5235c >2013-12-09 09:45:46,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3bb63537 >2013-12-09 09:45:46,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3bb63537 >2013-12-09 09:45:51,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5310b582 >2013-12-09 09:45:52,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5310b582 >2013-12-09 09:45:52,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 245145f >2013-12-09 09:45:52,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 245145f >2013-12-09 09:45:57,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 471b30ce >2013-12-09 09:45:57,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 471b30ce >2013-12-09 09:45:57,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 185f4a90 >2013-12-09 09:45:58,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 185f4a90 >2013-12-09 09:46:03,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4fb93db0 >2013-12-09 09:46:03,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4fb93db0 >2013-12-09 09:46:03,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ef2ad4e >2013-12-09 09:46:03,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ef2ad4e >2013-12-09 09:46:08,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ea69a7f >2013-12-09 09:46:09,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ea69a7f >2013-12-09 09:46:09,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c4f2103 >2013-12-09 09:46:09,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c4f2103 >2013-12-09 09:46:14,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 314c4141 >2013-12-09 09:46:15,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 314c4141 >2013-12-09 09:46:15,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37acb493 >2013-12-09 09:46:15,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37acb493 >2013-12-09 09:46:20,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f22e96 >2013-12-09 09:46:21,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f22e96 >2013-12-09 09:46:21,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 406b48d2 >2013-12-09 09:46:21,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 406b48d2 >2013-12-09 09:46:26,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 286e01f2 >2013-12-09 09:46:26,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 286e01f2 >2013-12-09 09:46:26,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43f071e7 >2013-12-09 09:46:27,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43f071e7 >2013-12-09 09:46:32,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d1bc49e >2013-12-09 09:46:32,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2d1bc49e >2013-12-09 09:46:32,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51008d42 >2013-12-09 09:46:32,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51008d42 >2013-12-09 09:46:37,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e5e319 >2013-12-09 09:46:38,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2e5e319 >2013-12-09 09:46:38,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11dbfcc8 >2013-12-09 09:46:38,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11dbfcc8 >2013-12-09 09:46:42,844 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-94) No up server in cluster >2013-12-09 09:46:42,845 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-94) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:46:42,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38b4f428 >2013-12-09 09:46:43,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterTasksListVDSCommand, return: [], log id: 38b4f428 >2013-12-09 09:46:43,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c38c7aa >2013-12-09 09:46:44,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c38c7aa >2013-12-09 09:46:44,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 82bde6 >2013-12-09 09:46:44,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 82bde6 >2013-12-09 09:46:49,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31d075cf >2013-12-09 09:46:49,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 31d075cf >2013-12-09 09:46:49,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1db64d8d >2013-12-09 09:46:50,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1db64d8d >2013-12-09 09:46:55,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76f8c6b0 >2013-12-09 09:46:55,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 76f8c6b0 >2013-12-09 09:46:55,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33e23e66 >2013-12-09 09:46:55,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33e23e66 >2013-12-09 09:47:00,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c222f0b >2013-12-09 09:47:01,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7c222f0b >2013-12-09 09:47:01,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13172a04 >2013-12-09 09:47:01,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13172a04 >2013-12-09 09:47:06,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29147950 >2013-12-09 09:47:07,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 29147950 >2013-12-09 09:47:07,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3beccb0a >2013-12-09 09:47:07,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3beccb0a >2013-12-09 09:47:12,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 249b6175 >2013-12-09 09:47:13,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 249b6175 >2013-12-09 09:47:13,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69bfd0e3 >2013-12-09 09:47:13,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69bfd0e3 >2013-12-09 09:47:18,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 395e360f >2013-12-09 09:47:18,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 395e360f >2013-12-09 09:47:18,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a699768 >2013-12-09 09:47:19,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a699768 >2013-12-09 09:47:24,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 779bc2ec >2013-12-09 09:47:24,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 779bc2ec >2013-12-09 09:47:24,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6be163ca >2013-12-09 09:47:24,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6be163ca >2013-12-09 09:47:29,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c207b9c >2013-12-09 09:47:30,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4c207b9c >2013-12-09 09:47:30,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62cb5d04 >2013-12-09 09:47:30,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62cb5d04 >2013-12-09 09:47:35,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4dbebddd >2013-12-09 09:47:36,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4dbebddd >2013-12-09 09:47:36,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29582fd >2013-12-09 09:47:36,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29582fd >2013-12-09 09:47:41,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6503c6bc >2013-12-09 09:47:41,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6503c6bc >2013-12-09 09:47:41,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a35543 >2013-12-09 09:47:42,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a35543 >2013-12-09 09:47:43,135 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) No up server in cluster >2013-12-09 09:47:43,135 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:47:43,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1df27c5 >2013-12-09 09:47:43,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1df27c5 >2013-12-09 09:47:47,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: cff2420 >2013-12-09 09:47:47,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: cff2420 >2013-12-09 09:47:47,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c76d788 >2013-12-09 09:47:47,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c76d788 >2013-12-09 09:47:52,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d20e9a8 >2013-12-09 09:47:53,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6d20e9a8 >2013-12-09 09:47:53,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42d5699 >2013-12-09 09:47:53,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42d5699 >2013-12-09 09:47:58,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 243c7839 >2013-12-09 09:47:59,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 243c7839 >2013-12-09 09:47:59,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d73b39b >2013-12-09 09:47:59,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d73b39b >2013-12-09 09:48:04,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 117c565f >2013-12-09 09:48:05,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 117c565f >2013-12-09 09:48:05,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41f376c4 >2013-12-09 09:48:05,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41f376c4 >2013-12-09 09:48:10,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 780bd6ac >2013-12-09 09:48:10,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 780bd6ac >2013-12-09 09:48:10,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 354f1684 >2013-12-09 09:48:11,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 354f1684 >2013-12-09 09:48:16,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c2ede74 >2013-12-09 09:48:16,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6c2ede74 >2013-12-09 09:48:16,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1900eb64 >2013-12-09 09:48:16,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1900eb64 >2013-12-09 09:48:21,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2306dc34 >2013-12-09 09:48:22,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2306dc34 >2013-12-09 09:48:22,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 386e1cc8 >2013-12-09 09:48:22,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 386e1cc8 >2013-12-09 09:48:27,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: efd6859 >2013-12-09 09:48:28,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: efd6859 >2013-12-09 09:48:28,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3de092f6 >2013-12-09 09:48:28,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3de092f6 >2013-12-09 09:48:33,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4cf5a811 >2013-12-09 09:48:33,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4cf5a811 >2013-12-09 09:48:33,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5656d0b2 >2013-12-09 09:48:34,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5656d0b2 >2013-12-09 09:48:39,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3173684e >2013-12-09 09:48:39,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3173684e >2013-12-09 09:48:39,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76514134 >2013-12-09 09:48:39,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76514134 >2013-12-09 09:48:43,404 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-75) No up server in cluster >2013-12-09 09:48:43,404 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-75) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:48:43,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b345033 >2013-12-09 09:48:43,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterTasksListVDSCommand, return: [], log id: b345033 >2013-12-09 09:48:44,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12dbc57c >2013-12-09 09:48:45,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 12dbc57c >2013-12-09 09:48:45,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 671777aa >2013-12-09 09:48:45,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 671777aa >2013-12-09 09:48:50,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6aca18f3 >2013-12-09 09:48:51,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6aca18f3 >2013-12-09 09:48:51,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40758ea3 >2013-12-09 09:48:51,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40758ea3 >2013-12-09 09:48:56,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c7e469f >2013-12-09 09:48:56,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c7e469f >2013-12-09 09:48:56,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4865a461 >2013-12-09 09:48:57,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4865a461 >2013-12-09 09:49:02,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e57bea4 >2013-12-09 09:49:02,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e57bea4 >2013-12-09 09:49:02,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6fe88abd >2013-12-09 09:49:03,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6fe88abd >2013-12-09 09:49:08,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f13cff4 >2013-12-09 09:49:08,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7f13cff4 >2013-12-09 09:49:08,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60b1b075 >2013-12-09 09:49:08,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60b1b075 >2013-12-09 09:49:13,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f8ed54a >2013-12-09 09:49:14,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3f8ed54a >2013-12-09 09:49:14,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e1b8ab1 >2013-12-09 09:49:14,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e1b8ab1 >2013-12-09 09:49:19,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a375f4 >2013-12-09 09:49:20,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: a375f4 >2013-12-09 09:49:20,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3beb1381 >2013-12-09 09:49:20,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3beb1381 >2013-12-09 09:49:25,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69125001 >2013-12-09 09:49:25,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 69125001 >2013-12-09 09:49:25,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d9bbdac >2013-12-09 09:49:26,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d9bbdac >2013-12-09 09:49:31,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c61db43 >2013-12-09 09:49:31,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6c61db43 >2013-12-09 09:49:31,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2215da05 >2013-12-09 09:49:31,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2215da05 >2013-12-09 09:49:36,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d9e9981 >2013-12-09 09:49:37,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d9e9981 >2013-12-09 09:49:37,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 537e7344 >2013-12-09 09:49:37,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 537e7344 >2013-12-09 09:49:42,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 149d5a38 >2013-12-09 09:49:43,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 149d5a38 >2013-12-09 09:49:43,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5dde92a6 >2013-12-09 09:49:43,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5dde92a6 >2013-12-09 09:49:43,678 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-99) No up server in cluster >2013-12-09 09:49:43,678 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-99) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:49:43,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ce355cd >2013-12-09 09:49:43,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6ce355cd >2013-12-09 09:49:48,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1cb81e05 >2013-12-09 09:49:49,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1cb81e05 >2013-12-09 09:49:49,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5eb3b8a4 >2013-12-09 09:49:49,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5eb3b8a4 >2013-12-09 09:49:54,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 306ac058 >2013-12-09 09:49:54,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 306ac058 >2013-12-09 09:49:54,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55f7e832 >2013-12-09 09:49:55,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55f7e832 >2013-12-09 09:50:00,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26b90145 >2013-12-09 09:50:00,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 26b90145 >2013-12-09 09:50:00,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11101346 >2013-12-09 09:50:00,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11101346 >2013-12-09 09:50:05,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46cb5bf9 >2013-12-09 09:50:06,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 46cb5bf9 >2013-12-09 09:50:06,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 654a5455 >2013-12-09 09:50:06,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 654a5455 >2013-12-09 09:50:11,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c2477a >2013-12-09 09:50:12,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c2477a >2013-12-09 09:50:12,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 446aff17 >2013-12-09 09:50:12,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 446aff17 >2013-12-09 09:50:17,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a2ed997 >2013-12-09 09:50:17,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a2ed997 >2013-12-09 09:50:17,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45f2aa27 >2013-12-09 09:50:18,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45f2aa27 >2013-12-09 09:50:23,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ae81219 >2013-12-09 09:50:23,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6ae81219 >2013-12-09 09:50:23,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63069347 >2013-12-09 09:50:23,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63069347 >2013-12-09 09:50:28,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c176a01 >2013-12-09 09:50:29,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c176a01 >2013-12-09 09:50:29,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ba42941 >2013-12-09 09:50:29,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ba42941 >2013-12-09 09:50:34,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d6215e >2013-12-09 09:50:35,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d6215e >2013-12-09 09:50:35,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15bb7ec7 >2013-12-09 09:50:35,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15bb7ec7 >2013-12-09 09:50:40,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5bfcb044 >2013-12-09 09:50:40,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5bfcb044 >2013-12-09 09:50:40,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b4cdf2c >2013-12-09 09:50:41,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b4cdf2c >2013-12-09 09:50:43,958 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) No up server in cluster >2013-12-09 09:50:43,958 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:50:43,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 582aa912 >2013-12-09 09:50:44,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterTasksListVDSCommand, return: [], log id: 582aa912 >2013-12-09 09:50:46,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26e47a6d >2013-12-09 09:50:46,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 26e47a6d >2013-12-09 09:50:46,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d0c6a6 >2013-12-09 09:50:46,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d0c6a6 >2013-12-09 09:50:52,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ee26373 >2013-12-09 09:50:52,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1ee26373 >2013-12-09 09:50:52,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43586d20 >2013-12-09 09:50:52,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43586d20 >2013-12-09 09:50:57,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38acc27c >2013-12-09 09:50:58,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 38acc27c >2013-12-09 09:50:58,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20bcc549 >2013-12-09 09:50:58,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20bcc549 >2013-12-09 09:51:03,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c2077ca >2013-12-09 09:51:04,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4c2077ca >2013-12-09 09:51:04,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5232eb48 >2013-12-09 09:51:04,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5232eb48 >2013-12-09 09:51:09,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f272c9a >2013-12-09 09:51:09,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f272c9a >2013-12-09 09:51:09,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e1eaaa3 >2013-12-09 09:51:10,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e1eaaa3 >2013-12-09 09:51:15,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38d34d08 >2013-12-09 09:51:15,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 38d34d08 >2013-12-09 09:51:15,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2aff8da9 >2013-12-09 09:51:15,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2aff8da9 >2013-12-09 09:51:20,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2965a783 >2013-12-09 09:51:21,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2965a783 >2013-12-09 09:51:21,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65cefbc5 >2013-12-09 09:51:21,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65cefbc5 >2013-12-09 09:51:26,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 172b09ec >2013-12-09 09:51:27,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 172b09ec >2013-12-09 09:51:27,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48f15f21 >2013-12-09 09:51:27,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48f15f21 >2013-12-09 09:51:32,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 342546f4 >2013-12-09 09:51:32,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 342546f4 >2013-12-09 09:51:32,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68c21d8a >2013-12-09 09:51:33,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68c21d8a >2013-12-09 09:51:38,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35775c36 >2013-12-09 09:51:38,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 35775c36 >2013-12-09 09:51:38,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29cdf25d >2013-12-09 09:51:38,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29cdf25d >2013-12-09 09:51:43,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ae542b9 >2013-12-09 09:51:44,232 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-59) No up server in cluster >2013-12-09 09:51:44,232 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-59) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:51:44,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c372d88 >2013-12-09 09:51:44,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ae542b9 >2013-12-09 09:51:44,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52a04808 >2013-12-09 09:51:44,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5c372d88 >2013-12-09 09:51:44,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52a04808 >2013-12-09 09:51:49,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a629697 >2013-12-09 09:51:50,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6a629697 >2013-12-09 09:51:50,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69043567 >2013-12-09 09:51:50,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69043567 >2013-12-09 09:51:55,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1756c6f6 >2013-12-09 09:51:56,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1756c6f6 >2013-12-09 09:51:56,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a41c3dd >2013-12-09 09:51:56,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a41c3dd >2013-12-09 09:52:01,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3443a050 >2013-12-09 09:52:01,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3443a050 >2013-12-09 09:52:01,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c58f187 >2013-12-09 09:52:02,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c58f187 >2013-12-09 09:52:07,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1eddb911 >2013-12-09 09:52:07,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1eddb911 >2013-12-09 09:52:07,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 312eceee >2013-12-09 09:52:07,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 312eceee >2013-12-09 09:52:12,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39589365 >2013-12-09 09:52:13,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 39589365 >2013-12-09 09:52:13,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2425c1f6 >2013-12-09 09:52:13,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2425c1f6 >2013-12-09 09:52:18,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1369d3fb >2013-12-09 09:52:19,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1369d3fb >2013-12-09 09:52:19,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a15f1d1 >2013-12-09 09:52:19,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a15f1d1 >2013-12-09 09:52:24,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c24f8ca >2013-12-09 09:52:24,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c24f8ca >2013-12-09 09:52:24,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4bacece8 >2013-12-09 09:52:25,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4bacece8 >2013-12-09 09:52:30,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71185fc1 >2013-12-09 09:52:30,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 71185fc1 >2013-12-09 09:52:30,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e2d651a >2013-12-09 09:52:30,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e2d651a >2013-12-09 09:52:35,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7afe428f >2013-12-09 09:52:36,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7afe428f >2013-12-09 09:52:36,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7163ccc >2013-12-09 09:52:36,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7163ccc >2013-12-09 09:52:41,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3bbf8b44 >2013-12-09 09:52:42,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3bbf8b44 >2013-12-09 09:52:42,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 232965a >2013-12-09 09:52:42,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 232965a >2013-12-09 09:52:44,505 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-28) No up server in cluster >2013-12-09 09:52:44,505 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-28) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:52:44,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4bf3d07e >2013-12-09 09:52:44,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4bf3d07e >2013-12-09 09:52:47,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5514d21b >2013-12-09 09:52:48,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5514d21b >2013-12-09 09:52:48,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 605dfefd >2013-12-09 09:52:48,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 605dfefd >2013-12-09 09:52:53,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11e09028 >2013-12-09 09:52:53,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 11e09028 >2013-12-09 09:52:53,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4815841a >2013-12-09 09:52:54,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4815841a >2013-12-09 09:52:59,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 554c1ab5 >2013-12-09 09:52:59,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 554c1ab5 >2013-12-09 09:52:59,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d4a71de >2013-12-09 09:52:59,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d4a71de >2013-12-09 09:53:04,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63fb6174 >2013-12-09 09:53:05,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 63fb6174 >2013-12-09 09:53:05,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17bf0ba9 >2013-12-09 09:53:05,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17bf0ba9 >2013-12-09 09:53:10,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 795d9b5b >2013-12-09 09:53:11,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 795d9b5b >2013-12-09 09:53:11,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e3421da >2013-12-09 09:53:11,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e3421da >2013-12-09 09:53:16,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ae0f8cb >2013-12-09 09:53:16,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2ae0f8cb >2013-12-09 09:53:16,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50ae1a0b >2013-12-09 09:53:17,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50ae1a0b >2013-12-09 09:53:22,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 332cea79 >2013-12-09 09:53:22,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 332cea79 >2013-12-09 09:53:22,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 100a1b88 >2013-12-09 09:53:23,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 100a1b88 >2013-12-09 09:53:28,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9836b03 >2013-12-09 09:53:28,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 9836b03 >2013-12-09 09:53:28,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66039a16 >2013-12-09 09:53:28,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66039a16 >2013-12-09 09:53:33,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70b78fef >2013-12-09 09:53:34,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 70b78fef >2013-12-09 09:53:34,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ced1dad >2013-12-09 09:53:34,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ced1dad >2013-12-09 09:53:39,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: eeb6641 >2013-12-09 09:53:40,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: eeb6641 >2013-12-09 09:53:40,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70fcbcb8 >2013-12-09 09:53:40,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70fcbcb8 >2013-12-09 09:53:44,787 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) No up server in cluster >2013-12-09 09:53:44,788 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:53:44,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 387ecc36 >2013-12-09 09:53:45,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterTasksListVDSCommand, return: [], log id: 387ecc36 >2013-12-09 09:53:45,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46e7e52f >2013-12-09 09:53:45,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 46e7e52f >2013-12-09 09:53:45,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 60b71db4 >2013-12-09 09:53:46,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60b71db4 >2013-12-09 09:53:51,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6aea628d >2013-12-09 09:53:51,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6aea628d >2013-12-09 09:53:51,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 634cbfee >2013-12-09 09:53:51,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 634cbfee >2013-12-09 09:53:56,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b35478b >2013-12-09 09:53:57,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b35478b >2013-12-09 09:53:57,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5cf9a69d >2013-12-09 09:53:57,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cf9a69d >2013-12-09 09:54:02,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53306b72 >2013-12-09 09:54:03,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 53306b72 >2013-12-09 09:54:03,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5525ad47 >2013-12-09 09:54:03,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5525ad47 >2013-12-09 09:54:08,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bf5cb9f >2013-12-09 09:54:08,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2bf5cb9f >2013-12-09 09:54:08,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79869cca >2013-12-09 09:54:09,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79869cca >2013-12-09 09:54:14,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76c597b0 >2013-12-09 09:54:14,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 76c597b0 >2013-12-09 09:54:14,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b91441e >2013-12-09 09:54:15,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b91441e >2013-12-09 09:54:20,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 688ea45a >2013-12-09 09:54:20,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 688ea45a >2013-12-09 09:54:20,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2edb6e24 >2013-12-09 09:54:20,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2edb6e24 >2013-12-09 09:54:25,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 154e1904 >2013-12-09 09:54:26,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 154e1904 >2013-12-09 09:54:26,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 175b7e3d >2013-12-09 09:54:26,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 175b7e3d >2013-12-09 09:54:31,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58a5375 >2013-12-09 09:54:32,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 58a5375 >2013-12-09 09:54:32,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 330aa132 >2013-12-09 09:54:32,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 330aa132 >2013-12-09 09:54:37,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f90c2f2 >2013-12-09 09:54:37,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f90c2f2 >2013-12-09 09:54:37,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 28434abe >2013-12-09 09:54:38,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28434abe >2013-12-09 09:54:43,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34fd8dd6 >2013-12-09 09:54:43,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 34fd8dd6 >2013-12-09 09:54:43,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f1aa1e0 >2013-12-09 09:54:43,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f1aa1e0 >2013-12-09 09:54:45,062 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-91) No up server in cluster >2013-12-09 09:54:45,063 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-91) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:54:45,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 464167e >2013-12-09 09:54:45,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterTasksListVDSCommand, return: [], log id: 464167e >2013-12-09 09:54:49,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e7110c6 >2013-12-09 09:54:49,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2e7110c6 >2013-12-09 09:54:49,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3085c393 >2013-12-09 09:54:49,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3085c393 >2013-12-09 09:54:54,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b647ec >2013-12-09 09:54:55,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b647ec >2013-12-09 09:54:55,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 25bcfa74 >2013-12-09 09:54:55,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25bcfa74 >2013-12-09 09:55:00,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10d0e09d >2013-12-09 09:55:01,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 10d0e09d >2013-12-09 09:55:01,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2600f76a >2013-12-09 09:55:01,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2600f76a >2013-12-09 09:55:06,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c61bf6 >2013-12-09 09:55:06,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c61bf6 >2013-12-09 09:55:06,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 296a16c0 >2013-12-09 09:55:07,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 296a16c0 >2013-12-09 09:55:12,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58ff6ba8 >2013-12-09 09:55:12,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 58ff6ba8 >2013-12-09 09:55:12,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a40b2f1 >2013-12-09 09:55:12,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a40b2f1 >2013-12-09 09:55:17,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 615cf396 >2013-12-09 09:55:18,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 615cf396 >2013-12-09 09:55:18,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ddcc8f1 >2013-12-09 09:55:18,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ddcc8f1 >2013-12-09 09:55:23,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2bfdfbe3 >2013-12-09 09:55:24,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2bfdfbe3 >2013-12-09 09:55:24,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3edece59 >2013-12-09 09:55:24,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3edece59 >2013-12-09 09:55:29,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 356251da >2013-12-09 09:55:29,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 356251da >2013-12-09 09:55:29,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f67d66f >2013-12-09 09:55:30,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f67d66f >2013-12-09 09:55:35,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75f346ba >2013-12-09 09:55:35,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 75f346ba >2013-12-09 09:55:35,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7aae7d5c >2013-12-09 09:55:35,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7aae7d5c >2013-12-09 09:55:40,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e2e1b69 >2013-12-09 09:55:41,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e2e1b69 >2013-12-09 09:55:41,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 218beed8 >2013-12-09 09:55:41,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 218beed8 >2013-12-09 09:55:45,330 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-71) No up server in cluster >2013-12-09 09:55:45,330 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-71) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:55:45,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: fff7f11 >2013-12-09 09:55:45,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterTasksListVDSCommand, return: [], log id: fff7f11 >2013-12-09 09:55:46,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 434ffcf6 >2013-12-09 09:55:47,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 434ffcf6 >2013-12-09 09:55:47,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25858bea >2013-12-09 09:55:47,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25858bea >2013-12-09 09:55:52,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4703c246 >2013-12-09 09:55:52,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4703c246 >2013-12-09 09:55:52,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bc52612 >2013-12-09 09:55:53,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bc52612 >2013-12-09 09:55:58,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 635bbf5f >2013-12-09 09:55:58,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 635bbf5f >2013-12-09 09:55:58,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7050a861 >2013-12-09 09:55:59,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7050a861 >2013-12-09 09:56:04,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a63e26 >2013-12-09 09:56:04,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a63e26 >2013-12-09 09:56:04,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79d299c5 >2013-12-09 09:56:04,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79d299c5 >2013-12-09 09:56:09,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21cc5490 >2013-12-09 09:56:10,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 21cc5490 >2013-12-09 09:56:10,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ac8c9c2 >2013-12-09 09:56:10,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ac8c9c2 >2013-12-09 09:56:15,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20ee5eeb >2013-12-09 09:56:16,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 20ee5eeb >2013-12-09 09:56:16,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11120361 >2013-12-09 09:56:16,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11120361 >2013-12-09 09:56:21,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e4c537c >2013-12-09 09:56:21,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e4c537c >2013-12-09 09:56:21,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d6d6e0 >2013-12-09 09:56:22,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d6d6e0 >2013-12-09 09:56:27,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65161558 >2013-12-09 09:56:27,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 65161558 >2013-12-09 09:56:27,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a8ba67e >2013-12-09 09:56:27,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a8ba67e >2013-12-09 09:56:32,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54ee2027 >2013-12-09 09:56:33,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 54ee2027 >2013-12-09 09:56:33,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d7e7d93 >2013-12-09 09:56:33,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d7e7d93 >2013-12-09 09:56:38,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7abc6729 >2013-12-09 09:56:39,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7abc6729 >2013-12-09 09:56:39,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 744418c1 >2013-12-09 09:56:39,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 744418c1 >2013-12-09 09:56:44,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4fdc53b >2013-12-09 09:56:45,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4fdc53b >2013-12-09 09:56:45,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42df916b >2013-12-09 09:56:45,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42df916b >2013-12-09 09:56:45,612 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-80) No up server in cluster >2013-12-09 09:56:45,612 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-80) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:56:45,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b5a8ebb >2013-12-09 09:56:45,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2b5a8ebb >2013-12-09 09:56:50,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 257922cc >2013-12-09 09:56:50,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 257922cc >2013-12-09 09:56:50,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6bb14a2c >2013-12-09 09:56:51,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6bb14a2c >2013-12-09 09:56:56,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d99b85 >2013-12-09 09:56:56,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d99b85 >2013-12-09 09:56:56,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 228da898 >2013-12-09 09:56:56,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 228da898 >2013-12-09 09:57:01,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 815449f >2013-12-09 09:57:02,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 815449f >2013-12-09 09:57:02,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29e24124 >2013-12-09 09:57:02,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29e24124 >2013-12-09 09:57:07,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48f724cb >2013-12-09 09:57:08,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 48f724cb >2013-12-09 09:57:08,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1636462d >2013-12-09 09:57:08,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1636462d >2013-12-09 09:57:13,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d65b573 >2013-12-09 09:57:13,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d65b573 >2013-12-09 09:57:13,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d3c2573 >2013-12-09 09:57:14,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d3c2573 >2013-12-09 09:57:19,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e7c39f7 >2013-12-09 09:57:19,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: e7c39f7 >2013-12-09 09:57:19,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 775a3d2a >2013-12-09 09:57:20,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 775a3d2a >2013-12-09 09:57:25,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8fd1eb7 >2013-12-09 09:57:25,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 8fd1eb7 >2013-12-09 09:57:25,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f3ff035 >2013-12-09 09:57:25,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f3ff035 >2013-12-09 09:57:30,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13e9e511 >2013-12-09 09:57:31,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 13e9e511 >2013-12-09 09:57:31,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d6f216b >2013-12-09 09:57:31,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d6f216b >2013-12-09 09:57:36,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46c66928 >2013-12-09 09:57:37,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 46c66928 >2013-12-09 09:57:37,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b196763 >2013-12-09 09:57:37,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b196763 >2013-12-09 09:57:42,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34833882 >2013-12-09 09:57:42,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 34833882 >2013-12-09 09:57:42,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 458d2b97 >2013-12-09 09:57:43,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 458d2b97 >2013-12-09 09:57:45,896 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-61) No up server in cluster >2013-12-09 09:57:45,896 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-61) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:57:45,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36044ffb >2013-12-09 09:57:46,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterTasksListVDSCommand, return: [], log id: 36044ffb >2013-12-09 09:57:48,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 719be369 >2013-12-09 09:57:48,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 719be369 >2013-12-09 09:57:48,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e58b8e >2013-12-09 09:57:48,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e58b8e >2013-12-09 09:57:53,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bdb51bc >2013-12-09 09:57:54,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2bdb51bc >2013-12-09 09:57:54,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ac9e03 >2013-12-09 09:57:54,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ac9e03 >2013-12-09 09:57:59,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b537c4f >2013-12-09 09:58:00,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4b537c4f >2013-12-09 09:58:00,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1811c2d4 >2013-12-09 09:58:00,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1811c2d4 >2013-12-09 09:58:05,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5bbe64fa >2013-12-09 09:58:05,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5bbe64fa >2013-12-09 09:58:05,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4dc0d819 >2013-12-09 09:58:06,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4dc0d819 >2013-12-09 09:58:11,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32b159ff >2013-12-09 09:58:11,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 32b159ff >2013-12-09 09:58:11,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70d671c3 >2013-12-09 09:58:12,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70d671c3 >2013-12-09 09:58:17,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: fda8a88 >2013-12-09 09:58:17,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: fda8a88 >2013-12-09 09:58:17,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 497e7fba >2013-12-09 09:58:17,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 497e7fba >2013-12-09 09:58:22,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3cae6412 >2013-12-09 09:58:23,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3cae6412 >2013-12-09 09:58:23,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36787f75 >2013-12-09 09:58:23,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36787f75 >2013-12-09 09:58:28,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 396e9243 >2013-12-09 09:58:29,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 396e9243 >2013-12-09 09:58:29,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e256dbb >2013-12-09 09:58:29,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e256dbb >2013-12-09 09:58:34,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37dc70fb >2013-12-09 09:58:34,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 37dc70fb >2013-12-09 09:58:34,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1146cda >2013-12-09 09:58:35,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1146cda >2013-12-09 09:58:40,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7752346c >2013-12-09 09:58:40,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7752346c >2013-12-09 09:58:40,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6542c68e >2013-12-09 09:58:40,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6542c68e >2013-12-09 09:58:45,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63a8510d >2013-12-09 09:58:46,186 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-84) No up server in cluster >2013-12-09 09:58:46,187 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-84) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:58:46,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c4816f6 >2013-12-09 09:58:46,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 63a8510d >2013-12-09 09:58:46,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5cd05e2 >2013-12-09 09:58:46,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7c4816f6 >2013-12-09 09:58:46,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cd05e2 >2013-12-09 09:58:51,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 485918b9 >2013-12-09 09:58:52,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 485918b9 >2013-12-09 09:58:52,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4052dd37 >2013-12-09 09:58:52,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4052dd37 >2013-12-09 09:58:57,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c4fbe70 >2013-12-09 09:58:57,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: c4fbe70 >2013-12-09 09:58:58,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76a29036 >2013-12-09 09:58:58,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76a29036 >2013-12-09 09:59:03,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6be38f3b >2013-12-09 09:59:03,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6be38f3b >2013-12-09 09:59:03,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1552cf18 >2013-12-09 09:59:04,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1552cf18 >2013-12-09 09:59:09,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5da51908 >2013-12-09 09:59:09,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5da51908 >2013-12-09 09:59:09,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57b4235b >2013-12-09 09:59:09,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57b4235b >2013-12-09 09:59:14,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ef5c33d >2013-12-09 09:59:15,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1ef5c33d >2013-12-09 09:59:15,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 636c2686 >2013-12-09 09:59:15,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 636c2686 >2013-12-09 09:59:20,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3eeff592 >2013-12-09 09:59:21,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3eeff592 >2013-12-09 09:59:21,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47313094 >2013-12-09 09:59:21,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47313094 >2013-12-09 09:59:26,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2fade4c6 >2013-12-09 09:59:26,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2fade4c6 >2013-12-09 09:59:26,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b6c3424 >2013-12-09 09:59:27,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b6c3424 >2013-12-09 09:59:32,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38ca76ca >2013-12-09 09:59:32,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 38ca76ca >2013-12-09 09:59:32,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45a6202c >2013-12-09 09:59:32,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45a6202c >2013-12-09 09:59:37,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42c3aea9 >2013-12-09 09:59:38,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 42c3aea9 >2013-12-09 09:59:38,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5541a62c >2013-12-09 09:59:38,742 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-15) Attempting to update VMs/Templates Ovf. >2013-12-09 09:59:38,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5541a62c >2013-12-09 09:59:43,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c176c23 >2013-12-09 09:59:44,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3c176c23 >2013-12-09 09:59:44,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3452d917 >2013-12-09 09:59:44,504 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-6) Start refreshing all users data >2013-12-09 09:59:44,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3452d917 >2013-12-09 09:59:44,524 ERROR [org.ovirt.engine.core.bll.adbroker.LDAPTemplateWrapper] (DefaultQuartzScheduler_Worker-6) Error in running LDAP query. BaseDN is , filter is (|(objectGUID=e2b822d6-f93e-4d65-829e-fe23a39cfe01)). Exception message is: Request: 4 cancelled; nested exception is javax.naming.CommunicationException: Request: 4 cancelled; remaining name '' >2013-12-09 09:59:44,527 ERROR [org.ovirt.engine.core.bll.adbroker.LdapSearchExceptionHandler] (DefaultQuartzScheduler_Worker-6) Error in communicating with LDAP server Request: 4 cancelled; nested exception is javax.naming.CommunicationException: Request: 4 cancelled; remaining name '' >2013-12-09 09:59:44,528 ERROR [org.ovirt.engine.core.bll.adbroker.DirectorySearcher] (DefaultQuartzScheduler_Worker-6) Failed ldap search server LDAP://win-bn8ckdkjeu0.ad.rhs-client48.lab.eng.blr.redhat.com:389 using user admin@AD.RHS-CLIENT48.LAB.ENG.BLR.REDHAT.COM due to communication error. We should try the next server >2013-12-09 09:59:44,535 ERROR [org.ovirt.engine.core.bll.adbroker.LdapSearchExceptionHandler] (DefaultQuartzScheduler_Worker-6) Error in communicating with LDAP server rhs-client3.lab.eng.blr.redhat.com:389; nested exception is javax.naming.CommunicationException: rhs-client3.lab.eng.blr.redhat.com:389 [Root exception is java.net.NoRouteToHostException: No route to host] >2013-12-09 09:59:44,535 ERROR [org.ovirt.engine.core.bll.adbroker.DirectorySearcher] (DefaultQuartzScheduler_Worker-6) Failed ldap search server LDAP://rhs-client3.lab.eng.blr.redhat.com:389 using user admin@AD.RHS-CLIENT48.LAB.ENG.BLR.REDHAT.COM due to rhs-client3.lab.eng.blr.redhat.com:389; nested exception is javax.naming.CommunicationException: rhs-client3.lab.eng.blr.redhat.com:389 [Root exception is java.net.NoRouteToHostException: No route to host]. We should try the next server >2013-12-09 09:59:44,536 WARN [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-6) User rhsc_user1 not found in directory server, its status switched to InActive >2013-12-09 09:59:46,462 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) No up server in cluster >2013-12-09 09:59:46,463 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 09:59:46,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a8097e0 >2013-12-09 09:59:46,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7a8097e0 >2013-12-09 09:59:49,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f075cd2 >2013-12-09 09:59:50,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7f075cd2 >2013-12-09 09:59:50,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5dedd129 >2013-12-09 09:59:50,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5dedd129 >2013-12-09 09:59:55,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c53566c >2013-12-09 09:59:55,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4c53566c >2013-12-09 09:59:55,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1af1f62c >2013-12-09 09:59:56,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1af1f62c >2013-12-09 10:00:01,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d6cf7 >2013-12-09 10:00:01,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6d6cf7 >2013-12-09 10:00:01,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 763fe9cf >2013-12-09 10:00:01,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 763fe9cf >2013-12-09 10:00:06,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b38525a >2013-12-09 10:00:07,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: b38525a >2013-12-09 10:00:07,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 635eea2b >2013-12-09 10:00:07,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 635eea2b >2013-12-09 10:00:12,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 787469e2 >2013-12-09 10:00:13,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 787469e2 >2013-12-09 10:00:13,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36d9f957 >2013-12-09 10:00:13,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36d9f957 >2013-12-09 10:00:18,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d655b6f >2013-12-09 10:00:18,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d655b6f >2013-12-09 10:00:18,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 515da3db >2013-12-09 10:00:19,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 515da3db >2013-12-09 10:00:24,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 413937dc >2013-12-09 10:00:24,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 413937dc >2013-12-09 10:00:24,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68cb0c92 >2013-12-09 10:00:24,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68cb0c92 >2013-12-09 10:00:29,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e20bf89 >2013-12-09 10:00:30,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6e20bf89 >2013-12-09 10:00:30,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d54bf26 >2013-12-09 10:00:30,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d54bf26 >2013-12-09 10:00:35,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52352d46 >2013-12-09 10:00:36,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 52352d46 >2013-12-09 10:00:36,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66627d0a >2013-12-09 10:00:36,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66627d0a >2013-12-09 10:00:41,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6babe113 >2013-12-09 10:00:41,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6babe113 >2013-12-09 10:00:41,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c06c1cd >2013-12-09 10:00:42,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c06c1cd >2013-12-09 10:00:46,757 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-98) No up server in cluster >2013-12-09 10:00:46,757 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-98) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:00:46,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 760583a >2013-12-09 10:00:47,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterTasksListVDSCommand, return: [], log id: 760583a >2013-12-09 10:00:47,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5bd876ec >2013-12-09 10:00:47,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5bd876ec >2013-12-09 10:00:47,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b0063fa >2013-12-09 10:00:47,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b0063fa >2013-12-09 10:00:52,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20b50ca7 >2013-12-09 10:00:53,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 20b50ca7 >2013-12-09 10:00:53,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77bf6016 >2013-12-09 10:00:53,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77bf6016 >2013-12-09 10:00:58,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c679394 >2013-12-09 10:00:59,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c679394 >2013-12-09 10:00:59,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58bb6574 >2013-12-09 10:00:59,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58bb6574 >2013-12-09 10:01:04,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a5829bf >2013-12-09 10:01:05,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a5829bf >2013-12-09 10:01:05,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47edc5cb >2013-12-09 10:01:05,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47edc5cb >2013-12-09 10:01:10,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 683f5928 >2013-12-09 10:01:10,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 683f5928 >2013-12-09 10:01:10,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f82ea96 >2013-12-09 10:01:11,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f82ea96 >2013-12-09 10:01:16,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42437b40 >2013-12-09 10:01:16,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42437b40 >2013-12-09 10:01:16,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f28b785 >2013-12-09 10:01:16,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f28b785 >2013-12-09 10:01:21,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 60a3ebd3 >2013-12-09 10:01:22,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 60a3ebd3 >2013-12-09 10:01:22,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 291f402e >2013-12-09 10:01:22,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 291f402e >2013-12-09 10:01:27,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 694ec160 >2013-12-09 10:01:28,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 694ec160 >2013-12-09 10:01:28,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72c48c35 >2013-12-09 10:01:28,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72c48c35 >2013-12-09 10:01:33,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b866f8f >2013-12-09 10:01:34,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: b866f8f >2013-12-09 10:01:34,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e166e69 >2013-12-09 10:01:34,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e166e69 >2013-12-09 10:01:39,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16423e52 >2013-12-09 10:01:39,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 16423e52 >2013-12-09 10:01:39,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a3c2239 >2013-12-09 10:01:40,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a3c2239 >2013-12-09 10:01:45,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c5bd061 >2013-12-09 10:01:45,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2c5bd061 >2013-12-09 10:01:45,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5796408 >2013-12-09 10:01:45,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5796408 >2013-12-09 10:01:47,039 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-57) No up server in cluster >2013-12-09 10:01:47,039 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-57) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:01:47,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fc77c86 >2013-12-09 10:01:47,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2fc77c86 >2013-12-09 10:01:50,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ec61cb8 >2013-12-09 10:01:51,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3ec61cb8 >2013-12-09 10:01:51,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 229621fc >2013-12-09 10:01:51,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 229621fc >2013-12-09 10:01:56,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43ef47d4 >2013-12-09 10:01:57,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 43ef47d4 >2013-12-09 10:01:57,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b676c67 >2013-12-09 10:01:57,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b676c67 >2013-12-09 10:02:02,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b3cfe00 >2013-12-09 10:02:02,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b3cfe00 >2013-12-09 10:02:02,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e536433 >2013-12-09 10:02:03,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e536433 >2013-12-09 10:02:08,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62af83b0 >2013-12-09 10:02:08,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 62af83b0 >2013-12-09 10:02:08,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 582f7f20 >2013-12-09 10:02:08,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 582f7f20 >2013-12-09 10:02:14,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b1dae44 >2013-12-09 10:02:14,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4b1dae44 >2013-12-09 10:02:14,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 146c5305 >2013-12-09 10:02:14,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 146c5305 >2013-12-09 10:02:19,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 277c3e8b >2013-12-09 10:02:20,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 277c3e8b >2013-12-09 10:02:20,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 244d1678 >2013-12-09 10:02:20,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 244d1678 >2013-12-09 10:02:25,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d6a8b70 >2013-12-09 10:02:26,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d6a8b70 >2013-12-09 10:02:26,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c33730c >2013-12-09 10:02:26,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c33730c >2013-12-09 10:02:31,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8581e04 >2013-12-09 10:02:31,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 8581e04 >2013-12-09 10:02:31,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f2bc0aa >2013-12-09 10:02:32,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f2bc0aa >2013-12-09 10:02:37,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f0f0929 >2013-12-09 10:02:37,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f0f0929 >2013-12-09 10:02:37,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bd1fa54 >2013-12-09 10:02:37,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4bd1fa54 >2013-12-09 10:02:42,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3357b61d >2013-12-09 10:02:43,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3357b61d >2013-12-09 10:02:43,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ed99444 >2013-12-09 10:02:43,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ed99444 >2013-12-09 10:02:47,317 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) No up server in cluster >2013-12-09 10:02:47,317 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:02:47,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8cf731f >2013-12-09 10:02:47,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterTasksListVDSCommand, return: [], log id: 8cf731f >2013-12-09 10:02:48,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c0e577a >2013-12-09 10:02:49,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3c0e577a >2013-12-09 10:02:49,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41f8816a >2013-12-09 10:02:49,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41f8816a >2013-12-09 10:02:54,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35e70c09 >2013-12-09 10:02:55,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 35e70c09 >2013-12-09 10:02:55,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69d4a1bc >2013-12-09 10:02:55,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69d4a1bc >2013-12-09 10:03:00,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 234f593 >2013-12-09 10:03:00,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 234f593 >2013-12-09 10:03:00,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27003973 >2013-12-09 10:03:01,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27003973 >2013-12-09 10:03:06,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5771297e >2013-12-09 10:03:06,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5771297e >2013-12-09 10:03:06,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a22b367 >2013-12-09 10:03:06,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a22b367 >2013-12-09 10:03:11,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49ff6640 >2013-12-09 10:03:12,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 49ff6640 >2013-12-09 10:03:12,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45950407 >2013-12-09 10:03:12,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45950407 >2013-12-09 10:03:17,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c31c687 >2013-12-09 10:03:18,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c31c687 >2013-12-09 10:03:18,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ee6bf62 >2013-12-09 10:03:18,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ee6bf62 >2013-12-09 10:03:23,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71754358 >2013-12-09 10:03:23,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 71754358 >2013-12-09 10:03:23,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6bbf0822 >2013-12-09 10:03:24,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6bbf0822 >2013-12-09 10:03:29,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e7e993c >2013-12-09 10:03:29,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1e7e993c >2013-12-09 10:03:29,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5169ccbc >2013-12-09 10:03:30,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5169ccbc >2013-12-09 10:03:35,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3107e323 >2013-12-09 10:03:35,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3107e323 >2013-12-09 10:03:35,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9a34ba8 >2013-12-09 10:03:35,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9a34ba8 >2013-12-09 10:03:40,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ad1b56d >2013-12-09 10:03:41,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ad1b56d >2013-12-09 10:03:41,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56c8cbea >2013-12-09 10:03:41,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56c8cbea >2013-12-09 10:03:46,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46a194d5 >2013-12-09 10:03:47,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 46a194d5 >2013-12-09 10:03:47,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6265d1d5 >2013-12-09 10:03:47,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6265d1d5 >2013-12-09 10:03:47,597 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-22) No up server in cluster >2013-12-09 10:03:47,597 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-22) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:03:47,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d828918 >2013-12-09 10:03:47,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1d828918 >2013-12-09 10:03:52,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44db5c12 >2013-12-09 10:03:52,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 44db5c12 >2013-12-09 10:03:52,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34315772 >2013-12-09 10:03:53,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34315772 >2013-12-09 10:03:58,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4461e72d >2013-12-09 10:03:58,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4461e72d >2013-12-09 10:03:58,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ccde131 >2013-12-09 10:03:58,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ccde131 >2013-12-09 10:04:04,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5654b44b >2013-12-09 10:04:04,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5654b44b >2013-12-09 10:04:04,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7808c59a >2013-12-09 10:04:04,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7808c59a >2013-12-09 10:04:09,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61696b5c >2013-12-09 10:04:10,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 61696b5c >2013-12-09 10:04:10,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 585f8ed3 >2013-12-09 10:04:10,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 585f8ed3 >2013-12-09 10:04:15,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f6f73e0 >2013-12-09 10:04:16,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f6f73e0 >2013-12-09 10:04:16,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a2bc07f >2013-12-09 10:04:16,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a2bc07f >2013-12-09 10:04:21,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33547648 >2013-12-09 10:04:21,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 33547648 >2013-12-09 10:04:21,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 305aff90 >2013-12-09 10:04:22,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 305aff90 >2013-12-09 10:04:27,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b2b8d6c >2013-12-09 10:04:27,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: b2b8d6c >2013-12-09 10:04:27,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61f00723 >2013-12-09 10:04:27,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61f00723 >2013-12-09 10:04:32,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37d96b51 >2013-12-09 10:04:33,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 37d96b51 >2013-12-09 10:04:33,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b8dfaa5 >2013-12-09 10:04:33,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b8dfaa5 >2013-12-09 10:04:38,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42675cc9 >2013-12-09 10:04:39,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42675cc9 >2013-12-09 10:04:39,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 345f3b62 >2013-12-09 10:04:39,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 345f3b62 >2013-12-09 10:04:44,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77c084af >2013-12-09 10:04:44,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 77c084af >2013-12-09 10:04:44,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 600a6a29 >2013-12-09 10:04:45,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 600a6a29 >2013-12-09 10:04:47,875 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-32) No up server in cluster >2013-12-09 10:04:47,875 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-32) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:04:47,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f37b4b8 >2013-12-09 10:04:48,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7f37b4b8 >2013-12-09 10:04:50,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42c21125 >2013-12-09 10:04:50,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42c21125 >2013-12-09 10:04:50,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73ab1801 >2013-12-09 10:04:50,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73ab1801 >2013-12-09 10:04:56,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b4fce79 >2013-12-09 10:04:56,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: b4fce79 >2013-12-09 10:04:56,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3551aefb >2013-12-09 10:04:56,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3551aefb >2013-12-09 10:05:01,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 92cd0cb >2013-12-09 10:05:02,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 92cd0cb >2013-12-09 10:05:02,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d5d64e6 >2013-12-09 10:05:02,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d5d64e6 >2013-12-09 10:05:07,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44d91768 >2013-12-09 10:05:08,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 44d91768 >2013-12-09 10:05:08,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 345bf3f7 >2013-12-09 10:05:08,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 345bf3f7 >2013-12-09 10:05:13,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60ab1d60 >2013-12-09 10:05:13,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 60ab1d60 >2013-12-09 10:05:13,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: bc849ad >2013-12-09 10:05:14,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: bc849ad >2013-12-09 10:05:19,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4eeb7fb0 >2013-12-09 10:05:19,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4eeb7fb0 >2013-12-09 10:05:19,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51583908 >2013-12-09 10:05:19,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51583908 >2013-12-09 10:05:24,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 354d6ea1 >2013-12-09 10:05:25,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 354d6ea1 >2013-12-09 10:05:25,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25fb1447 >2013-12-09 10:05:25,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25fb1447 >2013-12-09 10:05:30,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 563a7d0d >2013-12-09 10:05:31,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 563a7d0d >2013-12-09 10:05:31,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5178af01 >2013-12-09 10:05:31,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5178af01 >2013-12-09 10:05:36,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 480d4bfc >2013-12-09 10:05:37,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 480d4bfc >2013-12-09 10:05:37,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75f87ae5 >2013-12-09 10:05:37,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75f87ae5 >2013-12-09 10:05:42,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50480ae0 >2013-12-09 10:05:42,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 50480ae0 >2013-12-09 10:05:42,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 28609e7d >2013-12-09 10:05:43,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28609e7d >2013-12-09 10:05:48,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 492c65eb >2013-12-09 10:05:48,147 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-30) No up server in cluster >2013-12-09 10:05:48,147 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-30) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:05:48,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 349f3bc7 >2013-12-09 10:05:48,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterTasksListVDSCommand, return: [], log id: 349f3bc7 >2013-12-09 10:05:48,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 492c65eb >2013-12-09 10:05:48,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e39214f >2013-12-09 10:05:48,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e39214f >2013-12-09 10:05:53,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b5fe0c9 >2013-12-09 10:05:54,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: b5fe0c9 >2013-12-09 10:05:54,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d020bb3 >2013-12-09 10:05:54,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d020bb3 >2013-12-09 10:05:59,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 107e27d5 >2013-12-09 10:06:00,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 107e27d5 >2013-12-09 10:06:00,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56fba4a >2013-12-09 10:06:00,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56fba4a >2013-12-09 10:06:05,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71c74e02 >2013-12-09 10:06:05,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 71c74e02 >2013-12-09 10:06:05,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27cb944f >2013-12-09 10:06:06,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27cb944f >2013-12-09 10:06:11,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2826a91a >2013-12-09 10:06:11,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2826a91a >2013-12-09 10:06:11,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e74a8ea >2013-12-09 10:06:11,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e74a8ea >2013-12-09 10:06:16,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 104bbf9a >2013-12-09 10:06:17,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 104bbf9a >2013-12-09 10:06:17,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79aa570c >2013-12-09 10:06:17,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79aa570c >2013-12-09 10:06:22,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3cc380ff >2013-12-09 10:06:23,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3cc380ff >2013-12-09 10:06:23,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 576ec604 >2013-12-09 10:06:23,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 576ec604 >2013-12-09 10:06:28,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f87b16e >2013-12-09 10:06:29,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7f87b16e >2013-12-09 10:06:29,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e41a72f >2013-12-09 10:06:29,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e41a72f >2013-12-09 10:06:34,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1dabad04 >2013-12-09 10:06:34,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1dabad04 >2013-12-09 10:06:34,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69a2ba02 >2013-12-09 10:06:35,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69a2ba02 >2013-12-09 10:06:40,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 15ca9e67 >2013-12-09 10:06:40,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 15ca9e67 >2013-12-09 10:06:40,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27c58c95 >2013-12-09 10:06:40,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27c58c95 >2013-12-09 10:06:45,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d80357 >2013-12-09 10:06:46,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d80357 >2013-12-09 10:06:46,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e58ad98 >2013-12-09 10:06:46,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e58ad98 >2013-12-09 10:06:48,405 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-23) No up server in cluster >2013-12-09 10:06:48,405 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-23) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:06:48,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f36f2a0 >2013-12-09 10:06:48,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4f36f2a0 >2013-12-09 10:06:51,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 171b23c4 >2013-12-09 10:06:52,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 171b23c4 >2013-12-09 10:06:52,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12e026cb >2013-12-09 10:06:52,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12e026cb >2013-12-09 10:06:57,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d7e7817 >2013-12-09 10:06:57,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d7e7817 >2013-12-09 10:06:57,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 561ec44a >2013-12-09 10:06:58,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 561ec44a >2013-12-09 10:07:03,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: fe03291 >2013-12-09 10:07:03,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: fe03291 >2013-12-09 10:07:03,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d804ded >2013-12-09 10:07:03,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d804ded >2013-12-09 10:07:09,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d326f06 >2013-12-09 10:07:09,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: d326f06 >2013-12-09 10:07:09,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38154915 >2013-12-09 10:07:09,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38154915 >2013-12-09 10:07:14,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39628d76 >2013-12-09 10:07:15,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 39628d76 >2013-12-09 10:07:15,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c158c34 >2013-12-09 10:07:15,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c158c34 >2013-12-09 10:07:20,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 775daf71 >2013-12-09 10:07:20,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 775daf71 >2013-12-09 10:07:20,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38e19624 >2013-12-09 10:07:21,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38e19624 >2013-12-09 10:07:26,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e4e77fd >2013-12-09 10:07:26,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e4e77fd >2013-12-09 10:07:26,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9bf55d2 >2013-12-09 10:07:27,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9bf55d2 >2013-12-09 10:07:32,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49b77f98 >2013-12-09 10:07:32,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 49b77f98 >2013-12-09 10:07:32,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3476ceed >2013-12-09 10:07:32,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3476ceed >2013-12-09 10:07:37,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 322ecd7f >2013-12-09 10:07:38,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 322ecd7f >2013-12-09 10:07:38,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5cf0e29b >2013-12-09 10:07:38,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cf0e29b >2013-12-09 10:07:43,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7faa501f >2013-12-09 10:07:44,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7faa501f >2013-12-09 10:07:44,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43aa8251 >2013-12-09 10:07:44,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43aa8251 >2013-12-09 10:07:48,697 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-37) No up server in cluster >2013-12-09 10:07:48,697 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-37) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:07:48,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ad23b01 >2013-12-09 10:07:48,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6ad23b01 >2013-12-09 10:07:49,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 205b511d >2013-12-09 10:07:49,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 205b511d >2013-12-09 10:07:49,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64ae2fdc >2013-12-09 10:07:50,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64ae2fdc >2013-12-09 10:07:55,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4df7c835 >2013-12-09 10:07:55,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4df7c835 >2013-12-09 10:07:55,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 490842b >2013-12-09 10:07:55,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 490842b >2013-12-09 10:08:00,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a4d8fec >2013-12-09 10:08:01,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a4d8fec >2013-12-09 10:08:01,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d781578 >2013-12-09 10:08:01,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d781578 >2013-12-09 10:08:06,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2907c032 >2013-12-09 10:08:07,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2907c032 >2013-12-09 10:08:07,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ab75f07 >2013-12-09 10:08:07,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ab75f07 >2013-12-09 10:08:12,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f54557c >2013-12-09 10:08:12,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f54557c >2013-12-09 10:08:12,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5533f4 >2013-12-09 10:08:13,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5533f4 >2013-12-09 10:08:18,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 563de2f >2013-12-09 10:08:18,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 563de2f >2013-12-09 10:08:18,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 478f8836 >2013-12-09 10:08:19,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 478f8836 >2013-12-09 10:08:24,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3562d9de >2013-12-09 10:08:24,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3562d9de >2013-12-09 10:08:24,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10414ec5 >2013-12-09 10:08:24,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10414ec5 >2013-12-09 10:08:29,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17ee24a8 >2013-12-09 10:08:30,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 17ee24a8 >2013-12-09 10:08:30,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1531b689 >2013-12-09 10:08:30,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1531b689 >2013-12-09 10:08:35,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 761b4208 >2013-12-09 10:08:36,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 761b4208 >2013-12-09 10:08:36,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66bfaab0 >2013-12-09 10:08:36,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66bfaab0 >2013-12-09 10:08:41,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ad305fc >2013-12-09 10:08:41,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7ad305fc >2013-12-09 10:08:41,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29ce4edd >2013-12-09 10:08:42,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29ce4edd >2013-12-09 10:08:47,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ceb0903 >2013-12-09 10:08:47,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7ceb0903 >2013-12-09 10:08:47,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e84559e >2013-12-09 10:08:47,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e84559e >2013-12-09 10:08:48,969 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-64) No up server in cluster >2013-12-09 10:08:48,969 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-64) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:08:48,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 162cc696 >2013-12-09 10:08:49,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterTasksListVDSCommand, return: [], log id: 162cc696 >2013-12-09 10:08:52,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6be8c8ed >2013-12-09 10:08:53,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6be8c8ed >2013-12-09 10:08:53,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 638f5d26 >2013-12-09 10:08:53,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 638f5d26 >2013-12-09 10:08:58,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 231520b >2013-12-09 10:08:59,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 231520b >2013-12-09 10:08:59,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 403d480 >2013-12-09 10:08:59,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 403d480 >2013-12-09 10:09:04,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 529317fe >2013-12-09 10:09:05,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 529317fe >2013-12-09 10:09:05,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30a4a709 >2013-12-09 10:09:05,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30a4a709 >2013-12-09 10:09:10,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 44c37b5a >2013-12-09 10:09:10,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 44c37b5a >2013-12-09 10:09:10,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58a75b85 >2013-12-09 10:09:11,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58a75b85 >2013-12-09 10:09:16,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64c96fef >2013-12-09 10:09:16,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 64c96fef >2013-12-09 10:09:16,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 22a6d26e >2013-12-09 10:09:16,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22a6d26e >2013-12-09 10:09:21,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4865ae15 >2013-12-09 10:09:22,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4865ae15 >2013-12-09 10:09:22,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 696cfcde >2013-12-09 10:09:22,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 696cfcde >2013-12-09 10:09:27,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a7d8945 >2013-12-09 10:09:28,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: a7d8945 >2013-12-09 10:09:28,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9168224 >2013-12-09 10:09:28,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9168224 >2013-12-09 10:09:33,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e22b485 >2013-12-09 10:09:33,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2e22b485 >2013-12-09 10:09:33,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e95c1d9 >2013-12-09 10:09:34,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e95c1d9 >2013-12-09 10:09:39,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: bd467b0 >2013-12-09 10:09:39,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: bd467b0 >2013-12-09 10:09:39,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 285090e0 >2013-12-09 10:09:40,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 285090e0 >2013-12-09 10:09:45,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52c73589 >2013-12-09 10:09:45,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 52c73589 >2013-12-09 10:09:45,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ae483ff >2013-12-09 10:09:45,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ae483ff >2013-12-09 10:09:49,245 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-19) No up server in cluster >2013-12-09 10:09:49,245 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-19) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:09:49,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c2610b6 >2013-12-09 10:09:49,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7c2610b6 >2013-12-09 10:09:50,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1948ef2e >2013-12-09 10:09:51,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1948ef2e >2013-12-09 10:09:51,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71c6dd7e >2013-12-09 10:09:51,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71c6dd7e >2013-12-09 10:09:56,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 372f7747 >2013-12-09 10:09:57,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 372f7747 >2013-12-09 10:09:57,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7534d3ea >2013-12-09 10:09:57,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7534d3ea >2013-12-09 10:10:02,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 679a85c7 >2013-12-09 10:10:02,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 679a85c7 >2013-12-09 10:10:02,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36e64045 >2013-12-09 10:10:03,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36e64045 >2013-12-09 10:10:08,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 645e2ae0 >2013-12-09 10:10:08,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 645e2ae0 >2013-12-09 10:10:08,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50335bdc >2013-12-09 10:10:08,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50335bdc >2013-12-09 10:10:13,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3dd92f47 >2013-12-09 10:10:14,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3dd92f47 >2013-12-09 10:10:14,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35b7ea8 >2013-12-09 10:10:14,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35b7ea8 >2013-12-09 10:10:19,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75db040b >2013-12-09 10:10:20,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 75db040b >2013-12-09 10:10:20,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12505a5 >2013-12-09 10:10:20,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12505a5 >2013-12-09 10:10:25,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25559850 >2013-12-09 10:10:25,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 25559850 >2013-12-09 10:10:25,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77457a96 >2013-12-09 10:10:26,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77457a96 >2013-12-09 10:10:31,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c207daa >2013-12-09 10:10:31,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6c207daa >2013-12-09 10:10:31,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73b53639 >2013-12-09 10:10:32,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73b53639 >2013-12-09 10:10:37,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 25f15348 >2013-12-09 10:10:37,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 25f15348 >2013-12-09 10:10:37,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 247a268e >2013-12-09 10:10:37,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 247a268e >2013-12-09 10:10:42,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 775b19 >2013-12-09 10:10:43,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 775b19 >2013-12-09 10:10:43,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43f0dbf9 >2013-12-09 10:10:43,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43f0dbf9 >2013-12-09 10:10:48,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c9a6550 >2013-12-09 10:10:49,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2c9a6550 >2013-12-09 10:10:49,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 14f66a92 >2013-12-09 10:10:49,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14f66a92 >2013-12-09 10:10:49,536 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-82) No up server in cluster >2013-12-09 10:10:49,537 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-82) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:10:49,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 594183fa >2013-12-09 10:10:49,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterTasksListVDSCommand, return: [], log id: 594183fa >2013-12-09 10:10:54,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1408d17c >2013-12-09 10:10:54,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1408d17c >2013-12-09 10:10:54,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1416d106 >2013-12-09 10:10:55,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1416d106 >2013-12-09 10:11:00,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 86fc7c0 >2013-12-09 10:11:00,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 86fc7c0 >2013-12-09 10:11:00,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a0cff5 >2013-12-09 10:11:00,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a0cff5 >2013-12-09 10:11:05,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3bd34711 >2013-12-09 10:11:06,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3bd34711 >2013-12-09 10:11:06,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 150f4c30 >2013-12-09 10:11:06,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 150f4c30 >2013-12-09 10:11:11,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3539e629 >2013-12-09 10:11:12,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3539e629 >2013-12-09 10:11:12,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7bceca4c >2013-12-09 10:11:12,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7bceca4c >2013-12-09 10:11:17,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 532a193 >2013-12-09 10:11:18,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 532a193 >2013-12-09 10:11:18,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36c8a079 >2013-12-09 10:11:18,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36c8a079 >2013-12-09 10:11:23,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 691cd58e >2013-12-09 10:11:23,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 691cd58e >2013-12-09 10:11:23,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 207b803f >2013-12-09 10:11:24,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 207b803f >2013-12-09 10:11:29,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ca98814 >2013-12-09 10:11:29,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5ca98814 >2013-12-09 10:11:29,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 548a96da >2013-12-09 10:11:29,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 548a96da >2013-12-09 10:11:34,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7be94908 >2013-12-09 10:11:35,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7be94908 >2013-12-09 10:11:35,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f40c05d >2013-12-09 10:11:35,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f40c05d >2013-12-09 10:11:40,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 701c2cd7 >2013-12-09 10:11:41,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 701c2cd7 >2013-12-09 10:11:41,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3cb2b239 >2013-12-09 10:11:41,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3cb2b239 >2013-12-09 10:11:46,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 227975e6 >2013-12-09 10:11:46,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 227975e6 >2013-12-09 10:11:46,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55f12691 >2013-12-09 10:11:47,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55f12691 >2013-12-09 10:11:49,813 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-46) No up server in cluster >2013-12-09 10:11:49,813 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-46) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:11:49,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3035139 >2013-12-09 10:11:50,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3035139 >2013-12-09 10:11:52,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4396d0aa >2013-12-09 10:11:52,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4396d0aa >2013-12-09 10:11:52,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21b43ca1 >2013-12-09 10:11:53,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21b43ca1 >2013-12-09 10:11:58,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10bf052a >2013-12-09 10:11:58,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 10bf052a >2013-12-09 10:11:58,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a3c8699 >2013-12-09 10:11:58,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a3c8699 >2013-12-09 10:12:03,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ca0396d >2013-12-09 10:12:04,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1ca0396d >2013-12-09 10:12:04,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 166be65d >2013-12-09 10:12:04,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 166be65d >2013-12-09 10:12:09,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4207d9e7 >2013-12-09 10:12:10,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4207d9e7 >2013-12-09 10:12:10,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 966729c >2013-12-09 10:12:10,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 966729c >2013-12-09 10:12:15,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69801d22 >2013-12-09 10:12:15,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 69801d22 >2013-12-09 10:12:15,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69d87bc8 >2013-12-09 10:12:16,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69d87bc8 >2013-12-09 10:12:21,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f8e056f >2013-12-09 10:12:21,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3f8e056f >2013-12-09 10:12:21,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2550d78a >2013-12-09 10:12:21,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2550d78a >2013-12-09 10:12:26,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c1931ca >2013-12-09 10:12:27,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c1931ca >2013-12-09 10:12:27,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7bef9058 >2013-12-09 10:12:27,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7bef9058 >2013-12-09 10:12:32,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a4303a3 >2013-12-09 10:12:33,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4a4303a3 >2013-12-09 10:12:33,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 383b2a82 >2013-12-09 10:12:33,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 383b2a82 >2013-12-09 10:12:38,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64965467 >2013-12-09 10:12:39,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 64965467 >2013-12-09 10:12:39,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3be16531 >2013-12-09 10:12:39,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3be16531 >2013-12-09 10:12:44,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 98cb1b4 >2013-12-09 10:12:44,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 98cb1b4 >2013-12-09 10:12:44,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e554cef >2013-12-09 10:12:45,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e554cef >2013-12-09 10:12:50,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6cf1cc60 >2013-12-09 10:12:50,095 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-13) No up server in cluster >2013-12-09 10:12:50,095 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-13) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:12:50,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e01f937 >2013-12-09 10:12:50,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6e01f937 >2013-12-09 10:12:50,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6cf1cc60 >2013-12-09 10:12:50,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76fec7d5 >2013-12-09 10:12:50,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76fec7d5 >2013-12-09 10:12:55,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42e4b64d >2013-12-09 10:12:56,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42e4b64d >2013-12-09 10:12:56,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47e61ee >2013-12-09 10:12:56,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47e61ee >2013-12-09 10:13:01,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4138f19a >2013-12-09 10:13:02,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4138f19a >2013-12-09 10:13:02,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2df497a >2013-12-09 10:13:02,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2df497a >2013-12-09 10:13:07,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4931b2fd >2013-12-09 10:13:07,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4931b2fd >2013-12-09 10:13:07,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6133c0b6 >2013-12-09 10:13:08,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6133c0b6 >2013-12-09 10:13:13,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 771f5a02 >2013-12-09 10:13:13,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 771f5a02 >2013-12-09 10:13:13,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1360bf >2013-12-09 10:13:13,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1360bf >2013-12-09 10:13:18,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7323b24 >2013-12-09 10:13:19,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7323b24 >2013-12-09 10:13:19,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ae206ef >2013-12-09 10:13:19,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ae206ef >2013-12-09 10:13:24,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74427e62 >2013-12-09 10:13:25,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 74427e62 >2013-12-09 10:13:25,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 736c5613 >2013-12-09 10:13:25,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 736c5613 >2013-12-09 10:13:30,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52d9a366 >2013-12-09 10:13:31,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 52d9a366 >2013-12-09 10:13:31,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36cc3d39 >2013-12-09 10:13:31,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36cc3d39 >2013-12-09 10:13:36,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: cb44a24 >2013-12-09 10:13:36,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: cb44a24 >2013-12-09 10:13:36,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a52c12d >2013-12-09 10:13:37,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a52c12d >2013-12-09 10:13:42,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 570bd491 >2013-12-09 10:13:42,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 570bd491 >2013-12-09 10:13:42,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4321bd51 >2013-12-09 10:13:42,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4321bd51 >2013-12-09 10:13:47,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5bd7da60 >2013-12-09 10:13:48,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5bd7da60 >2013-12-09 10:13:48,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4897b57b >2013-12-09 10:13:48,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4897b57b >2013-12-09 10:13:50,371 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-74) No up server in cluster >2013-12-09 10:13:50,371 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-74) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:13:50,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 408ff660 >2013-12-09 10:13:50,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterTasksListVDSCommand, return: [], log id: 408ff660 >2013-12-09 10:13:53,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bc94a41 >2013-12-09 10:13:54,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2bc94a41 >2013-12-09 10:13:54,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 424597f5 >2013-12-09 10:13:54,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 424597f5 >2013-12-09 10:13:59,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37027660 >2013-12-09 10:13:59,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 37027660 >2013-12-09 10:13:59,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e81e1ee >2013-12-09 10:14:00,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e81e1ee >2013-12-09 10:14:05,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32f50210 >2013-12-09 10:14:05,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 32f50210 >2013-12-09 10:14:05,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66b1e7e5 >2013-12-09 10:14:05,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66b1e7e5 >2013-12-09 10:14:10,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 762b9b54 >2013-12-09 10:14:11,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 762b9b54 >2013-12-09 10:14:11,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b24f5a3 >2013-12-09 10:14:11,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b24f5a3 >2013-12-09 10:14:16,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e47147b >2013-12-09 10:14:17,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e47147b >2013-12-09 10:14:17,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4218647c >2013-12-09 10:14:17,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4218647c >2013-12-09 10:14:22,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e89e533 >2013-12-09 10:14:23,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e89e533 >2013-12-09 10:14:23,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1dff6111 >2013-12-09 10:14:23,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1dff6111 >2013-12-09 10:14:28,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3cc0a867 >2013-12-09 10:14:28,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3cc0a867 >2013-12-09 10:14:28,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65eba3fd >2013-12-09 10:14:29,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65eba3fd >2013-12-09 10:14:34,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7802dda4 >2013-12-09 10:14:34,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7802dda4 >2013-12-09 10:14:34,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d8fac17 >2013-12-09 10:14:34,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d8fac17 >2013-12-09 10:14:39,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4bbf2dd1 >2013-12-09 10:14:40,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4bbf2dd1 >2013-12-09 10:14:40,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ce8d7f4 >2013-12-09 10:14:40,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ce8d7f4 >2013-12-09 10:14:45,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5087e12a >2013-12-09 10:14:46,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5087e12a >2013-12-09 10:14:46,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37366e35 >2013-12-09 10:14:46,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37366e35 >2013-12-09 10:14:50,659 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-50) No up server in cluster >2013-12-09 10:14:50,659 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-50) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:14:50,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1739dd1f >2013-12-09 10:14:50,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1739dd1f >2013-12-09 10:14:51,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b2efd01 >2013-12-09 10:14:51,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b2efd01 >2013-12-09 10:14:52,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9f4a3c9 >2013-12-09 10:14:52,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9f4a3c9 >2013-12-09 10:14:57,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2dd83634 >2013-12-09 10:14:57,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2dd83634 >2013-12-09 10:14:57,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b0ade98 >2013-12-09 10:14:58,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b0ade98 >2013-12-09 10:15:03,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b7de69b >2013-12-09 10:15:03,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b7de69b >2013-12-09 10:15:03,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e9ee31d >2013-12-09 10:15:03,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e9ee31d >2013-12-09 10:15:08,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e0ff92b >2013-12-09 10:15:09,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7e0ff92b >2013-12-09 10:15:09,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69e3fd09 >2013-12-09 10:15:09,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69e3fd09 >2013-12-09 10:15:14,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: aacfa08 >2013-12-09 10:15:15,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: aacfa08 >2013-12-09 10:15:15,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 358e14a1 >2013-12-09 10:15:15,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 358e14a1 >2013-12-09 10:15:20,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e469d09 >2013-12-09 10:15:20,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1e469d09 >2013-12-09 10:15:20,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ee27610 >2013-12-09 10:15:21,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ee27610 >2013-12-09 10:15:26,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e9f784d >2013-12-09 10:15:26,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2e9f784d >2013-12-09 10:15:26,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32948d27 >2013-12-09 10:15:26,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32948d27 >2013-12-09 10:15:31,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16f67fa5 >2013-12-09 10:15:32,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 16f67fa5 >2013-12-09 10:15:32,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 504d8fe5 >2013-12-09 10:15:32,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 504d8fe5 >2013-12-09 10:15:37,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60dd7be >2013-12-09 10:15:38,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 60dd7be >2013-12-09 10:15:38,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16e97ca9 >2013-12-09 10:15:38,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16e97ca9 >2013-12-09 10:15:43,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17d32eb2 >2013-12-09 10:15:43,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 17d32eb2 >2013-12-09 10:15:43,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55d2aa01 >2013-12-09 10:15:44,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55d2aa01 >2013-12-09 10:15:49,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c96708f >2013-12-09 10:15:49,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5c96708f >2013-12-09 10:15:49,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e289785 >2013-12-09 10:15:49,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e289785 >2013-12-09 10:15:50,938 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-49) No up server in cluster >2013-12-09 10:15:50,939 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-49) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:15:50,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 254071e7 >2013-12-09 10:15:51,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterTasksListVDSCommand, return: [], log id: 254071e7 >2013-12-09 10:15:55,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d886592 >2013-12-09 10:15:55,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d886592 >2013-12-09 10:15:55,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ebf7b18 >2013-12-09 10:15:55,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ebf7b18 >2013-12-09 10:16:00,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f20f10b >2013-12-09 10:16:01,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f20f10b >2013-12-09 10:16:01,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64c5b031 >2013-12-09 10:16:01,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64c5b031 >2013-12-09 10:16:06,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68981cf3 >2013-12-09 10:16:07,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 68981cf3 >2013-12-09 10:16:07,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38a3f26a >2013-12-09 10:16:07,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38a3f26a >2013-12-09 10:16:12,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 120f1a84 >2013-12-09 10:16:12,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 120f1a84 >2013-12-09 10:16:12,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 15565adb >2013-12-09 10:16:13,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15565adb >2013-12-09 10:16:18,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ddb4586 >2013-12-09 10:16:18,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5ddb4586 >2013-12-09 10:16:18,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ba3433d >2013-12-09 10:16:18,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ba3433d >2013-12-09 10:16:23,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21cc5f07 >2013-12-09 10:16:24,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 21cc5f07 >2013-12-09 10:16:24,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ed0da49 >2013-12-09 10:16:24,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ed0da49 >2013-12-09 10:16:29,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7597a814 >2013-12-09 10:16:30,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7597a814 >2013-12-09 10:16:30,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: eae4329 >2013-12-09 10:16:30,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: eae4329 >2013-12-09 10:16:35,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f7c9ac3 >2013-12-09 10:16:35,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f7c9ac3 >2013-12-09 10:16:35,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f1d4ada >2013-12-09 10:16:36,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f1d4ada >2013-12-09 10:16:41,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 205c788e >2013-12-09 10:16:41,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 205c788e >2013-12-09 10:16:41,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8e9ea5b >2013-12-09 10:16:42,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8e9ea5b >2013-12-09 10:16:47,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2eaf8ef7 >2013-12-09 10:16:47,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2eaf8ef7 >2013-12-09 10:16:47,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5be8e5b5 >2013-12-09 10:16:47,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5be8e5b5 >2013-12-09 10:16:51,212 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-30) No up server in cluster >2013-12-09 10:16:51,212 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-30) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:16:51,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 570639f >2013-12-09 10:16:51,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterTasksListVDSCommand, return: [], log id: 570639f >2013-12-09 10:16:52,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62c64ec3 >2013-12-09 10:16:53,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 62c64ec3 >2013-12-09 10:16:53,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 22e7d443 >2013-12-09 10:16:53,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22e7d443 >2013-12-09 10:16:58,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78f679de >2013-12-09 10:16:59,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 78f679de >2013-12-09 10:16:59,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2975fae2 >2013-12-09 10:16:59,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2975fae2 >2013-12-09 10:17:04,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23df15ab >2013-12-09 10:17:04,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 23df15ab >2013-12-09 10:17:04,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46838d9c >2013-12-09 10:17:05,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46838d9c >2013-12-09 10:17:10,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4bd1e854 >2013-12-09 10:17:10,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4bd1e854 >2013-12-09 10:17:10,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e727ec0 >2013-12-09 10:17:10,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e727ec0 >2013-12-09 10:17:15,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a50ff55 >2013-12-09 10:17:16,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2a50ff55 >2013-12-09 10:17:16,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f3a1b44 >2013-12-09 10:17:16,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f3a1b44 >2013-12-09 10:17:21,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b70667a >2013-12-09 10:17:22,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4b70667a >2013-12-09 10:17:22,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79514bbc >2013-12-09 10:17:22,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79514bbc >2013-12-09 10:17:27,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40757c87 >2013-12-09 10:17:27,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 40757c87 >2013-12-09 10:17:27,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5207e295 >2013-12-09 10:17:28,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5207e295 >2013-12-09 10:17:33,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c69749c >2013-12-09 10:17:33,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c69749c >2013-12-09 10:17:33,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1817beb8 >2013-12-09 10:17:34,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1817beb8 >2013-12-09 10:17:39,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21af09ca >2013-12-09 10:17:39,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 21af09ca >2013-12-09 10:17:39,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 28b0fe42 >2013-12-09 10:17:39,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28b0fe42 >2013-12-09 10:17:44,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6231275f >2013-12-09 10:17:45,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6231275f >2013-12-09 10:17:45,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b09d875 >2013-12-09 10:17:45,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b09d875 >2013-12-09 10:17:50,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c7842be >2013-12-09 10:17:51,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1c7842be >2013-12-09 10:17:51,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f8b543d >2013-12-09 10:17:51,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f8b543d >2013-12-09 10:17:51,507 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-76) No up server in cluster >2013-12-09 10:17:51,508 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-76) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:17:51,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b4bf8c7 >2013-12-09 10:17:51,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2b4bf8c7 >2013-12-09 10:17:56,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56746ea8 >2013-12-09 10:17:56,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 56746ea8 >2013-12-09 10:17:56,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f2eef7e >2013-12-09 10:17:57,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f2eef7e >2013-12-09 10:18:02,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1df0e1d4 >2013-12-09 10:18:02,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1df0e1d4 >2013-12-09 10:18:02,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18c78c5a >2013-12-09 10:18:02,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18c78c5a >2013-12-09 10:18:07,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6583d721 >2013-12-09 10:18:08,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6583d721 >2013-12-09 10:18:08,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e91f6b3 >2013-12-09 10:18:08,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e91f6b3 >2013-12-09 10:18:13,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27c0c567 >2013-12-09 10:18:14,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 27c0c567 >2013-12-09 10:18:14,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 411cfb91 >2013-12-09 10:18:14,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 411cfb91 >2013-12-09 10:18:19,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56ad0969 >2013-12-09 10:18:20,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 56ad0969 >2013-12-09 10:18:20,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f8f336 >2013-12-09 10:18:20,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f8f336 >2013-12-09 10:18:25,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f9624df >2013-12-09 10:18:25,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f9624df >2013-12-09 10:18:25,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c8dd9f5 >2013-12-09 10:18:26,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c8dd9f5 >2013-12-09 10:18:31,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78c1cd41 >2013-12-09 10:18:31,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 78c1cd41 >2013-12-09 10:18:31,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 699f157 >2013-12-09 10:18:31,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 699f157 >2013-12-09 10:18:36,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3348a20 >2013-12-09 10:18:37,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3348a20 >2013-12-09 10:18:37,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c193062 >2013-12-09 10:18:37,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c193062 >2013-12-09 10:18:42,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ae77c9a >2013-12-09 10:18:43,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7ae77c9a >2013-12-09 10:18:43,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 711b94e2 >2013-12-09 10:18:43,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 711b94e2 >2013-12-09 10:18:48,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38a43351 >2013-12-09 10:18:48,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 38a43351 >2013-12-09 10:18:48,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 729d5ffa >2013-12-09 10:18:49,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 729d5ffa >2013-12-09 10:18:51,788 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-4) No up server in cluster >2013-12-09 10:18:51,788 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-4) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:18:51,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50a3f6e0 >2013-12-09 10:18:52,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterTasksListVDSCommand, return: [], log id: 50a3f6e0 >2013-12-09 10:18:54,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e261575 >2013-12-09 10:18:54,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2e261575 >2013-12-09 10:18:54,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46e0d27c >2013-12-09 10:18:54,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46e0d27c >2013-12-09 10:18:59,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b3e0a60 >2013-12-09 10:19:00,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b3e0a60 >2013-12-09 10:19:00,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67bdb576 >2013-12-09 10:19:00,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67bdb576 >2013-12-09 10:19:05,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 213a95c >2013-12-09 10:19:06,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 213a95c >2013-12-09 10:19:06,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33705162 >2013-12-09 10:19:06,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33705162 >2013-12-09 10:19:11,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f15bfb5 >2013-12-09 10:19:12,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f15bfb5 >2013-12-09 10:19:12,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d690c31 >2013-12-09 10:19:12,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d690c31 >2013-12-09 10:19:17,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47b3111d >2013-12-09 10:19:17,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 47b3111d >2013-12-09 10:19:17,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11b8f379 >2013-12-09 10:19:18,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11b8f379 >2013-12-09 10:19:23,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 102c77df >2013-12-09 10:19:23,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 102c77df >2013-12-09 10:19:23,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 538366ba >2013-12-09 10:19:23,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 538366ba >2013-12-09 10:19:28,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 399b3a32 >2013-12-09 10:19:29,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 399b3a32 >2013-12-09 10:19:29,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d4c9df4 >2013-12-09 10:19:29,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d4c9df4 >2013-12-09 10:19:34,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e87684f >2013-12-09 10:19:35,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3e87684f >2013-12-09 10:19:35,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 494313aa >2013-12-09 10:19:35,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 494313aa >2013-12-09 10:19:40,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f6e283d >2013-12-09 10:19:40,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1f6e283d >2013-12-09 10:19:40,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 637a6670 >2013-12-09 10:19:41,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 637a6670 >2013-12-09 10:19:46,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52713d63 >2013-12-09 10:19:46,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 52713d63 >2013-12-09 10:19:46,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 367fedb5 >2013-12-09 10:19:46,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 367fedb5 >2013-12-09 10:19:51,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66f50b5 >2013-12-09 10:19:52,071 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-80) No up server in cluster >2013-12-09 10:19:52,071 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-80) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:19:52,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21a6b9a1 >2013-12-09 10:19:52,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterTasksListVDSCommand, return: [], log id: 21a6b9a1 >2013-12-09 10:19:52,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 66f50b5 >2013-12-09 10:19:52,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55ae5fc8 >2013-12-09 10:19:52,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55ae5fc8 >2013-12-09 10:19:57,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79486d29 >2013-12-09 10:19:58,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 79486d29 >2013-12-09 10:19:58,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b1e37b1 >2013-12-09 10:19:58,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b1e37b1 >2013-12-09 10:20:03,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c5e55d >2013-12-09 10:20:04,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c5e55d >2013-12-09 10:20:04,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45462c3f >2013-12-09 10:20:04,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45462c3f >2013-12-09 10:20:09,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62e75331 >2013-12-09 10:20:09,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 62e75331 >2013-12-09 10:20:09,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bb694ca >2013-12-09 10:20:10,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4bb694ca >2013-12-09 10:20:15,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 403d6ba0 >2013-12-09 10:20:15,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 403d6ba0 >2013-12-09 10:20:15,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56b34a09 >2013-12-09 10:20:15,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56b34a09 >2013-12-09 10:20:20,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 140b6353 >2013-12-09 10:20:21,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 140b6353 >2013-12-09 10:20:21,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7de27191 >2013-12-09 10:20:21,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7de27191 >2013-12-09 10:20:26,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58a069eb >2013-12-09 10:20:27,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 58a069eb >2013-12-09 10:20:27,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 144a3aaa >2013-12-09 10:20:27,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 144a3aaa >2013-12-09 10:20:32,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31821f57 >2013-12-09 10:20:33,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 31821f57 >2013-12-09 10:20:33,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: abe3017 >2013-12-09 10:20:33,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: abe3017 >2013-12-09 10:20:38,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bf840ad >2013-12-09 10:20:38,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4bf840ad >2013-12-09 10:20:38,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 717c463 >2013-12-09 10:20:39,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 717c463 >2013-12-09 10:20:44,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46b2a9bb >2013-12-09 10:20:44,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 46b2a9bb >2013-12-09 10:20:44,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ccefdb >2013-12-09 10:20:44,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ccefdb >2013-12-09 10:20:49,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 15bf232 >2013-12-09 10:20:50,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 15bf232 >2013-12-09 10:20:50,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3fbdda0e >2013-12-09 10:20:50,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3fbdda0e >2013-12-09 10:20:52,337 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-47) No up server in cluster >2013-12-09 10:20:52,337 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-47) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:20:52,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63f5b188 >2013-12-09 10:20:52,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterTasksListVDSCommand, return: [], log id: 63f5b188 >2013-12-09 10:20:55,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f6240a2 >2013-12-09 10:20:56,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f6240a2 >2013-12-09 10:20:56,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ba2084b >2013-12-09 10:20:56,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ba2084b >2013-12-09 10:21:01,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3eb5df2 >2013-12-09 10:21:01,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3eb5df2 >2013-12-09 10:21:01,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: bf4e0d3 >2013-12-09 10:21:02,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: bf4e0d3 >2013-12-09 10:21:07,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56cd9fc6 >2013-12-09 10:21:07,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 56cd9fc6 >2013-12-09 10:21:07,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8528b78 >2013-12-09 10:21:07,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8528b78 >2013-12-09 10:21:12,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c6b059b >2013-12-09 10:21:13,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: c6b059b >2013-12-09 10:21:13,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 128c9ef7 >2013-12-09 10:21:13,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 128c9ef7 >2013-12-09 10:21:18,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e0b494e >2013-12-09 10:21:19,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3e0b494e >2013-12-09 10:21:19,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a781ca1 >2013-12-09 10:21:19,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a781ca1 >2013-12-09 10:21:24,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ad69f74 >2013-12-09 10:21:24,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ad69f74 >2013-12-09 10:21:25,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 565ab318 >2013-12-09 10:21:25,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 565ab318 >2013-12-09 10:21:30,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 254e2fce >2013-12-09 10:21:30,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 254e2fce >2013-12-09 10:21:30,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 761a16d5 >2013-12-09 10:21:31,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 761a16d5 >2013-12-09 10:21:36,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2677d14 >2013-12-09 10:21:36,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2677d14 >2013-12-09 10:21:36,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3eb41056 >2013-12-09 10:21:36,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3eb41056 >2013-12-09 10:21:41,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5fbcd86a >2013-12-09 10:21:42,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5fbcd86a >2013-12-09 10:21:42,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33fb867f >2013-12-09 10:21:42,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33fb867f >2013-12-09 10:21:47,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33551b58 >2013-12-09 10:21:48,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 33551b58 >2013-12-09 10:21:48,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5717230d >2013-12-09 10:21:48,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5717230d >2013-12-09 10:21:52,627 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-12) No up server in cluster >2013-12-09 10:21:52,627 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-12) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:21:52,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2438faa8 >2013-12-09 10:21:52,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2438faa8 >2013-12-09 10:21:53,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d0976a7 >2013-12-09 10:21:53,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6d0976a7 >2013-12-09 10:21:53,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66cac043 >2013-12-09 10:21:54,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66cac043 >2013-12-09 10:21:59,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6019b81b >2013-12-09 10:21:59,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6019b81b >2013-12-09 10:21:59,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26bbd977 >2013-12-09 10:21:59,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26bbd977 >2013-12-09 10:22:04,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e210aab >2013-12-09 10:22:05,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2e210aab >2013-12-09 10:22:05,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61c4b53c >2013-12-09 10:22:05,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61c4b53c >2013-12-09 10:22:10,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 534054 >2013-12-09 10:22:11,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 534054 >2013-12-09 10:22:11,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75ca195a >2013-12-09 10:22:11,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75ca195a >2013-12-09 10:22:16,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64b0a057 >2013-12-09 10:22:17,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 64b0a057 >2013-12-09 10:22:17,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 127ad0ec >2013-12-09 10:22:17,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 127ad0ec >2013-12-09 10:22:22,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b6b58b8 >2013-12-09 10:22:22,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1b6b58b8 >2013-12-09 10:22:22,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 642d7e48 >2013-12-09 10:22:23,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 642d7e48 >2013-12-09 10:22:28,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c047df1 >2013-12-09 10:22:28,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c047df1 >2013-12-09 10:22:28,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5fbc2e0d >2013-12-09 10:22:28,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fbc2e0d >2013-12-09 10:22:33,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c425d94 >2013-12-09 10:22:34,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c425d94 >2013-12-09 10:22:34,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 15542e85 >2013-12-09 10:22:34,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15542e85 >2013-12-09 10:22:39,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f7fec9f >2013-12-09 10:22:40,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f7fec9f >2013-12-09 10:22:40,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24f35467 >2013-12-09 10:22:40,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24f35467 >2013-12-09 10:22:45,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50846848 >2013-12-09 10:22:46,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 50846848 >2013-12-09 10:22:46,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56a4b442 >2013-12-09 10:22:46,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56a4b442 >2013-12-09 10:22:51,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77c93faf >2013-12-09 10:22:51,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 77c93faf >2013-12-09 10:22:51,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c73d8d8 >2013-12-09 10:22:52,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c73d8d8 >2013-12-09 10:22:52,914 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-92) No up server in cluster >2013-12-09 10:22:52,914 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-92) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:22:52,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1855ae20 >2013-12-09 10:22:53,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1855ae20 >2013-12-09 10:22:57,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59e009a3 >2013-12-09 10:22:57,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59e009a3 >2013-12-09 10:22:57,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4df6e50e >2013-12-09 10:22:57,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4df6e50e >2013-12-09 10:23:02,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c5b2d09 >2013-12-09 10:23:03,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c5b2d09 >2013-12-09 10:23:03,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: bf4987 >2013-12-09 10:23:03,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: bf4987 >2013-12-09 10:23:08,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e909d71 >2013-12-09 10:23:09,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e909d71 >2013-12-09 10:23:09,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ed94bc7 >2013-12-09 10:23:09,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ed94bc7 >2013-12-09 10:23:14,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4119055d >2013-12-09 10:23:15,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4119055d >2013-12-09 10:23:15,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6008be34 >2013-12-09 10:23:15,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6008be34 >2013-12-09 10:23:20,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76a0226e >2013-12-09 10:23:20,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 76a0226e >2013-12-09 10:23:20,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e0cf441 >2013-12-09 10:23:21,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e0cf441 >2013-12-09 10:23:26,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65dfcd07 >2013-12-09 10:23:26,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 65dfcd07 >2013-12-09 10:23:26,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c3961e3 >2013-12-09 10:23:26,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c3961e3 >2013-12-09 10:23:31,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 552ba9ae >2013-12-09 10:23:32,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 552ba9ae >2013-12-09 10:23:32,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31dc7be4 >2013-12-09 10:23:32,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31dc7be4 >2013-12-09 10:23:37,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e46ea0f >2013-12-09 10:23:38,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2e46ea0f >2013-12-09 10:23:38,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1cd9dc87 >2013-12-09 10:23:38,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1cd9dc87 >2013-12-09 10:23:43,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23037578 >2013-12-09 10:23:43,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 23037578 >2013-12-09 10:23:43,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5dd7007d >2013-12-09 10:23:44,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5dd7007d >2013-12-09 10:23:49,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b218a8f >2013-12-09 10:23:49,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b218a8f >2013-12-09 10:23:49,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7574659b >2013-12-09 10:23:49,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7574659b >2013-12-09 10:23:53,200 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-45) No up server in cluster >2013-12-09 10:23:53,200 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-45) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:23:53,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71aa1e24 >2013-12-09 10:23:53,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterTasksListVDSCommand, return: [], log id: 71aa1e24 >2013-12-09 10:23:55,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19040197 >2013-12-09 10:23:55,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 19040197 >2013-12-09 10:23:55,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1346f82 >2013-12-09 10:23:55,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1346f82 >2013-12-09 10:24:00,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 388953b5 >2013-12-09 10:24:01,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 388953b5 >2013-12-09 10:24:01,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e691f1d >2013-12-09 10:24:01,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e691f1d >2013-12-09 10:24:06,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 599bd786 >2013-12-09 10:24:07,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 599bd786 >2013-12-09 10:24:07,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12d7a05c >2013-12-09 10:24:07,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12d7a05c >2013-12-09 10:24:12,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38af0650 >2013-12-09 10:24:12,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 38af0650 >2013-12-09 10:24:12,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38f98016 >2013-12-09 10:24:13,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38f98016 >2013-12-09 10:24:18,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16bc0287 >2013-12-09 10:24:18,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 16bc0287 >2013-12-09 10:24:18,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: aee19d1 >2013-12-09 10:24:18,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: aee19d1 >2013-12-09 10:24:23,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 615a45fb >2013-12-09 10:24:24,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 615a45fb >2013-12-09 10:24:24,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75ff4123 >2013-12-09 10:24:24,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75ff4123 >2013-12-09 10:24:29,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65a595fd >2013-12-09 10:24:30,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 65a595fd >2013-12-09 10:24:30,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 393c421d >2013-12-09 10:24:30,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 393c421d >2013-12-09 10:24:35,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f308729 >2013-12-09 10:24:35,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f308729 >2013-12-09 10:24:35,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2409614a >2013-12-09 10:24:36,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2409614a >2013-12-09 10:24:41,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a27fb76 >2013-12-09 10:24:41,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1a27fb76 >2013-12-09 10:24:41,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ff2a61 >2013-12-09 10:24:42,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ff2a61 >2013-12-09 10:24:47,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27104e7f >2013-12-09 10:24:47,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 27104e7f >2013-12-09 10:24:47,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7800cf61 >2013-12-09 10:24:47,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7800cf61 >2013-12-09 10:24:52,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b1309f3 >2013-12-09 10:24:53,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b1309f3 >2013-12-09 10:24:53,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4faa919 >2013-12-09 10:24:53,485 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-87) No up server in cluster >2013-12-09 10:24:53,485 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-87) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:24:53,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3281750b >2013-12-09 10:24:53,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4faa919 >2013-12-09 10:24:53,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3281750b >2013-12-09 10:24:58,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12909156 >2013-12-09 10:24:59,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 12909156 >2013-12-09 10:24:59,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2804925a >2013-12-09 10:24:59,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2804925a >2013-12-09 10:25:04,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b6e1da6 >2013-12-09 10:25:04,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3b6e1da6 >2013-12-09 10:25:04,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7fd191b1 >2013-12-09 10:25:05,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fd191b1 >2013-12-09 10:25:10,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6526e503 >2013-12-09 10:25:10,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6526e503 >2013-12-09 10:25:10,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1beb40c >2013-12-09 10:25:10,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1beb40c >2013-12-09 10:25:15,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6bee50d6 >2013-12-09 10:25:16,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6bee50d6 >2013-12-09 10:25:16,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57eb847d >2013-12-09 10:25:16,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57eb847d >2013-12-09 10:25:21,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3cd7d294 >2013-12-09 10:25:22,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3cd7d294 >2013-12-09 10:25:22,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17e342db >2013-12-09 10:25:22,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17e342db >2013-12-09 10:25:27,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ce1ffa3 >2013-12-09 10:25:28,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: ce1ffa3 >2013-12-09 10:25:28,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d6f0dae >2013-12-09 10:25:28,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d6f0dae >2013-12-09 10:25:33,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58cb0432 >2013-12-09 10:25:33,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 58cb0432 >2013-12-09 10:25:33,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f47878d >2013-12-09 10:25:34,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f47878d >2013-12-09 10:25:39,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f8f4951 >2013-12-09 10:25:39,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: f8f4951 >2013-12-09 10:25:39,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3eb418e >2013-12-09 10:25:39,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3eb418e >2013-12-09 10:25:44,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d176293 >2013-12-09 10:25:45,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5d176293 >2013-12-09 10:25:45,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2fc1f8f3 >2013-12-09 10:25:45,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2fc1f8f3 >2013-12-09 10:25:50,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ca6c089 >2013-12-09 10:25:51,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ca6c089 >2013-12-09 10:25:51,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ab5cad1 >2013-12-09 10:25:51,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ab5cad1 >2013-12-09 10:25:53,778 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-18) No up server in cluster >2013-12-09 10:25:53,778 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-18) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:25:53,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f33e8cb >2013-12-09 10:25:54,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6f33e8cb >2013-12-09 10:25:56,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5846968e >2013-12-09 10:25:56,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5846968e >2013-12-09 10:25:56,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36931132 >2013-12-09 10:25:57,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36931132 >2013-12-09 10:26:02,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 360c466d >2013-12-09 10:26:02,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 360c466d >2013-12-09 10:26:02,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3fe8a77b >2013-12-09 10:26:02,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3fe8a77b >2013-12-09 10:26:07,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3db65f42 >2013-12-09 10:26:08,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3db65f42 >2013-12-09 10:26:08,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 574e4f26 >2013-12-09 10:26:08,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 574e4f26 >2013-12-09 10:26:13,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61e19edb >2013-12-09 10:26:14,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 61e19edb >2013-12-09 10:26:14,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 642161ec >2013-12-09 10:26:14,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 642161ec >2013-12-09 10:26:19,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a58f82b >2013-12-09 10:26:19,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3a58f82b >2013-12-09 10:26:19,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1fb8cb9b >2013-12-09 10:26:20,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1fb8cb9b >2013-12-09 10:26:25,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 22685552 >2013-12-09 10:26:25,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 22685552 >2013-12-09 10:26:25,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 616807d1 >2013-12-09 10:26:26,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 616807d1 >2013-12-09 10:26:31,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4714a772 >2013-12-09 10:26:31,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4714a772 >2013-12-09 10:26:31,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 394c6dd0 >2013-12-09 10:26:31,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 394c6dd0 >2013-12-09 10:26:36,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6dbf124e >2013-12-09 10:26:37,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6dbf124e >2013-12-09 10:26:37,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 614dfcfa >2013-12-09 10:26:37,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 614dfcfa >2013-12-09 10:26:42,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 22d90b3d >2013-12-09 10:26:43,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 22d90b3d >2013-12-09 10:26:43,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e1bc50e >2013-12-09 10:26:43,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e1bc50e >2013-12-09 10:26:48,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3695d808 >2013-12-09 10:26:48,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3695d808 >2013-12-09 10:26:48,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b667c0e >2013-12-09 10:26:49,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b667c0e >2013-12-09 10:26:54,047 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-67) No up server in cluster >2013-12-09 10:26:54,048 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-67) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:26:54,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5738f6f1 >2013-12-09 10:26:54,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4440785d >2013-12-09 10:26:54,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5738f6f1 >2013-12-09 10:26:54,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4440785d >2013-12-09 10:26:54,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d5851db >2013-12-09 10:26:54,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d5851db >2013-12-09 10:26:59,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c85420c >2013-12-09 10:27:00,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4c85420c >2013-12-09 10:27:00,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8f7963e >2013-12-09 10:27:00,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8f7963e >2013-12-09 10:27:05,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78f1a1ec >2013-12-09 10:27:06,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 78f1a1ec >2013-12-09 10:27:06,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5bad9b8f >2013-12-09 10:27:06,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5bad9b8f >2013-12-09 10:27:11,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e18a8ef >2013-12-09 10:27:11,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7e18a8ef >2013-12-09 10:27:11,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18070cc7 >2013-12-09 10:27:12,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18070cc7 >2013-12-09 10:27:17,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 824837 >2013-12-09 10:27:17,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 824837 >2013-12-09 10:27:17,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5065a9f >2013-12-09 10:27:17,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5065a9f >2013-12-09 10:27:22,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c1eca2c >2013-12-09 10:27:23,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c1eca2c >2013-12-09 10:27:23,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5daaaa46 >2013-12-09 10:27:23,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5daaaa46 >2013-12-09 10:27:28,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62eb8a53 >2013-12-09 10:27:29,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 62eb8a53 >2013-12-09 10:27:29,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7da3a2ac >2013-12-09 10:27:29,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7da3a2ac >2013-12-09 10:27:34,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 905c028 >2013-12-09 10:27:35,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 905c028 >2013-12-09 10:27:35,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ca5459 >2013-12-09 10:27:35,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ca5459 >2013-12-09 10:27:40,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50303a97 >2013-12-09 10:27:40,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 50303a97 >2013-12-09 10:27:40,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 641b9260 >2013-12-09 10:27:41,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 641b9260 >2013-12-09 10:27:46,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7cb6b456 >2013-12-09 10:27:46,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7cb6b456 >2013-12-09 10:27:46,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 536f3fce >2013-12-09 10:27:46,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 536f3fce >2013-12-09 10:27:51,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f76b18e >2013-12-09 10:27:52,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5f76b18e >2013-12-09 10:27:52,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2bac4c11 >2013-12-09 10:27:52,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bac4c11 >2013-12-09 10:27:54,305 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-20) No up server in cluster >2013-12-09 10:27:54,306 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-20) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:27:54,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b9e3ad0 >2013-12-09 10:27:54,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2b9e3ad0 >2013-12-09 10:27:57,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55e74018 >2013-12-09 10:27:58,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 55e74018 >2013-12-09 10:27:58,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b39b7fb >2013-12-09 10:27:58,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b39b7fb >2013-12-09 10:28:03,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77d436e5 >2013-12-09 10:28:03,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 77d436e5 >2013-12-09 10:28:03,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a98b36c >2013-12-09 10:28:04,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a98b36c >2013-12-09 10:28:09,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 169eb00f >2013-12-09 10:28:09,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 169eb00f >2013-12-09 10:28:09,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e972f0a >2013-12-09 10:28:10,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e972f0a >2013-12-09 10:28:15,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d28ae65 >2013-12-09 10:28:15,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d28ae65 >2013-12-09 10:28:15,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6cd438b0 >2013-12-09 10:28:15,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6cd438b0 >2013-12-09 10:28:20,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 574b331c >2013-12-09 10:28:21,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 574b331c >2013-12-09 10:28:21,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f29439 >2013-12-09 10:28:21,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f29439 >2013-12-09 10:28:26,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ca2d787 >2013-12-09 10:28:27,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2ca2d787 >2013-12-09 10:28:27,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 758d861e >2013-12-09 10:28:27,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 758d861e >2013-12-09 10:28:32,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31badb1b >2013-12-09 10:28:32,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 31badb1b >2013-12-09 10:28:32,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7967c3e6 >2013-12-09 10:28:33,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7967c3e6 >2013-12-09 10:28:38,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6eef9f45 >2013-12-09 10:28:38,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6eef9f45 >2013-12-09 10:28:38,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f74e892 >2013-12-09 10:28:38,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f74e892 >2013-12-09 10:28:43,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e0003ea >2013-12-09 10:28:44,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e0003ea >2013-12-09 10:28:44,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 656fb38e >2013-12-09 10:28:44,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 656fb38e >2013-12-09 10:28:49,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 186e7d94 >2013-12-09 10:28:50,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 186e7d94 >2013-12-09 10:28:50,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68d81ca6 >2013-12-09 10:28:50,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68d81ca6 >2013-12-09 10:28:54,587 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-91) No up server in cluster >2013-12-09 10:28:54,587 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-91) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:28:54,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 687984b4 >2013-12-09 10:28:54,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterTasksListVDSCommand, return: [], log id: 687984b4 >2013-12-09 10:28:55,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61f500da >2013-12-09 10:28:55,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 61f500da >2013-12-09 10:28:55,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ebf591 >2013-12-09 10:28:56,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ebf591 >2013-12-09 10:29:01,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39558c4e >2013-12-09 10:29:01,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 39558c4e >2013-12-09 10:29:01,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e7b6b6f >2013-12-09 10:29:01,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e7b6b6f >2013-12-09 10:29:06,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f21368d >2013-12-09 10:29:07,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1f21368d >2013-12-09 10:29:07,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11886a32 >2013-12-09 10:29:07,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11886a32 >2013-12-09 10:29:12,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36142692 >2013-12-09 10:29:13,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 36142692 >2013-12-09 10:29:13,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d052043 >2013-12-09 10:29:13,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d052043 >2013-12-09 10:29:18,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c4886f1 >2013-12-09 10:29:19,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6c4886f1 >2013-12-09 10:29:19,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7aae89ee >2013-12-09 10:29:19,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7aae89ee >2013-12-09 10:29:24,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18d31105 >2013-12-09 10:29:24,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 18d31105 >2013-12-09 10:29:24,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56f2ed60 >2013-12-09 10:29:25,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56f2ed60 >2013-12-09 10:29:30,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3642bc26 >2013-12-09 10:29:30,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3642bc26 >2013-12-09 10:29:30,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4212c1ad >2013-12-09 10:29:30,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4212c1ad >2013-12-09 10:29:35,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e430041 >2013-12-09 10:29:36,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6e430041 >2013-12-09 10:29:36,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ddbab56 >2013-12-09 10:29:36,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ddbab56 >2013-12-09 10:29:41,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b4958ad >2013-12-09 10:29:42,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b4958ad >2013-12-09 10:29:42,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 88e0a0f >2013-12-09 10:29:42,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 88e0a0f >2013-12-09 10:29:47,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 629b546c >2013-12-09 10:29:47,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 629b546c >2013-12-09 10:29:47,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b64d74d >2013-12-09 10:29:48,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b64d74d >2013-12-09 10:29:53,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d405b0 >2013-12-09 10:29:53,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d405b0 >2013-12-09 10:29:53,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7477d98f >2013-12-09 10:29:54,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7477d98f >2013-12-09 10:29:54,868 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-58) No up server in cluster >2013-12-09 10:29:54,868 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-58) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:29:54,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b4aedf9 >2013-12-09 10:29:55,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4b4aedf9 >2013-12-09 10:29:59,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b0c8bf1 >2013-12-09 10:29:59,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b0c8bf1 >2013-12-09 10:29:59,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2770f3e5 >2013-12-09 10:29:59,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2770f3e5 >2013-12-09 10:30:04,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d6fdabe >2013-12-09 10:30:05,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d6fdabe >2013-12-09 10:30:05,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 251d7af7 >2013-12-09 10:30:05,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 251d7af7 >2013-12-09 10:30:10,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f6738bb >2013-12-09 10:30:11,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3f6738bb >2013-12-09 10:30:11,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 386a4f6 >2013-12-09 10:30:11,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 386a4f6 >2013-12-09 10:30:16,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13324309 >2013-12-09 10:30:16,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 13324309 >2013-12-09 10:30:16,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a8378af >2013-12-09 10:30:17,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a8378af >2013-12-09 10:30:22,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54784551 >2013-12-09 10:30:22,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 54784551 >2013-12-09 10:30:22,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 271a2abe >2013-12-09 10:30:22,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 271a2abe >2013-12-09 10:30:27,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 591ca164 >2013-12-09 10:30:28,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 591ca164 >2013-12-09 10:30:28,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 737ce8cc >2013-12-09 10:30:28,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 737ce8cc >2013-12-09 10:30:33,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 235b69f5 >2013-12-09 10:30:34,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 235b69f5 >2013-12-09 10:30:34,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50d39545 >2013-12-09 10:30:34,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50d39545 >2013-12-09 10:30:39,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3648c8c4 >2013-12-09 10:30:39,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3648c8c4 >2013-12-09 10:30:39,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6354acae >2013-12-09 10:30:40,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6354acae >2013-12-09 10:30:45,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69fc7eeb >2013-12-09 10:30:45,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 69fc7eeb >2013-12-09 10:30:45,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 418a65c0 >2013-12-09 10:30:46,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 418a65c0 >2013-12-09 10:30:51,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 60606e40 >2013-12-09 10:30:51,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 60606e40 >2013-12-09 10:30:51,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39cf4e8a >2013-12-09 10:30:51,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39cf4e8a >2013-12-09 10:30:55,148 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) No up server in cluster >2013-12-09 10:30:55,148 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:30:55,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e7a234a >2013-12-09 10:30:55,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3e7a234a >2013-12-09 10:30:56,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b61cfdc >2013-12-09 10:30:57,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b61cfdc >2013-12-09 10:30:57,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3edfde3 >2013-12-09 10:30:57,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3edfde3 >2013-12-09 10:31:02,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36fc46bd >2013-12-09 10:31:03,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 36fc46bd >2013-12-09 10:31:03,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a7539b0 >2013-12-09 10:31:03,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a7539b0 >2013-12-09 10:31:08,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6707cc74 >2013-12-09 10:31:08,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6707cc74 >2013-12-09 10:31:08,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b8de42d >2013-12-09 10:31:09,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b8de42d >2013-12-09 10:31:14,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c31edd0 >2013-12-09 10:31:14,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7c31edd0 >2013-12-09 10:31:14,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50da4fe8 >2013-12-09 10:31:14,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50da4fe8 >2013-12-09 10:31:19,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 162604e0 >2013-12-09 10:31:20,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 162604e0 >2013-12-09 10:31:20,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69a2f862 >2013-12-09 10:31:20,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69a2f862 >2013-12-09 10:31:25,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16ee8b83 >2013-12-09 10:31:26,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 16ee8b83 >2013-12-09 10:31:26,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b8fd2d7 >2013-12-09 10:31:26,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b8fd2d7 >2013-12-09 10:31:31,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 107d053f >2013-12-09 10:31:32,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 107d053f >2013-12-09 10:31:32,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e74eb90 >2013-12-09 10:31:32,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e74eb90 >2013-12-09 10:31:37,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33f07cca >2013-12-09 10:31:37,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 33f07cca >2013-12-09 10:31:37,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 693cd2a4 >2013-12-09 10:31:38,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 693cd2a4 >2013-12-09 10:31:43,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79117bb3 >2013-12-09 10:31:43,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 79117bb3 >2013-12-09 10:31:43,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62e3be93 >2013-12-09 10:31:43,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62e3be93 >2013-12-09 10:31:48,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6023afe5 >2013-12-09 10:31:49,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6023afe5 >2013-12-09 10:31:49,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1df6c0c2 >2013-12-09 10:31:49,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1df6c0c2 >2013-12-09 10:31:54,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b6b52d2 >2013-12-09 10:31:55,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b6b52d2 >2013-12-09 10:31:55,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70a51baa >2013-12-09 10:31:55,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70a51baa >2013-12-09 10:31:55,437 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-50) No up server in cluster >2013-12-09 10:31:55,437 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-50) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:31:55,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 178937b5 >2013-12-09 10:31:55,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterTasksListVDSCommand, return: [], log id: 178937b5 >2013-12-09 10:32:00,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64f697d6 >2013-12-09 10:32:00,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 64f697d6 >2013-12-09 10:32:00,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5601a3de >2013-12-09 10:32:01,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5601a3de >2013-12-09 10:32:06,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a20b330 >2013-12-09 10:32:06,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7a20b330 >2013-12-09 10:32:06,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b898a07 >2013-12-09 10:32:06,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b898a07 >2013-12-09 10:32:11,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59385483 >2013-12-09 10:32:12,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 59385483 >2013-12-09 10:32:12,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13942925 >2013-12-09 10:32:12,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13942925 >2013-12-09 10:32:17,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c934b8d >2013-12-09 10:32:18,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c934b8d >2013-12-09 10:32:18,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e62fcf2 >2013-12-09 10:32:18,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e62fcf2 >2013-12-09 10:32:23,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 712a5991 >2013-12-09 10:32:24,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 712a5991 >2013-12-09 10:32:24,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 966be5a >2013-12-09 10:32:24,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 966be5a >2013-12-09 10:32:29,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e482f17 >2013-12-09 10:32:29,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4e482f17 >2013-12-09 10:32:29,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c22b9cd >2013-12-09 10:32:30,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c22b9cd >2013-12-09 10:32:35,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 632d95cd >2013-12-09 10:32:35,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 632d95cd >2013-12-09 10:32:35,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a14b9ab >2013-12-09 10:32:35,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a14b9ab >2013-12-09 10:32:40,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c27b16c >2013-12-09 10:32:41,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c27b16c >2013-12-09 10:32:41,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47f20b76 >2013-12-09 10:32:41,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47f20b76 >2013-12-09 10:32:46,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5cddc451 >2013-12-09 10:32:47,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5cddc451 >2013-12-09 10:32:47,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27767c23 >2013-12-09 10:32:47,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27767c23 >2013-12-09 10:32:52,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65f2fe66 >2013-12-09 10:32:52,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 65f2fe66 >2013-12-09 10:32:52,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38b2a7f4 >2013-12-09 10:32:53,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38b2a7f4 >2013-12-09 10:32:55,728 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-12) No up server in cluster >2013-12-09 10:32:55,728 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-12) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:32:55,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 274f9629 >2013-12-09 10:32:55,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterTasksListVDSCommand, return: [], log id: 274f9629 >2013-12-09 10:32:58,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 231f54c2 >2013-12-09 10:32:58,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 231f54c2 >2013-12-09 10:32:58,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28dba879 >2013-12-09 10:32:58,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28dba879 >2013-12-09 10:33:03,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f4d8d4b >2013-12-09 10:33:04,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f4d8d4b >2013-12-09 10:33:04,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7dcb61de >2013-12-09 10:33:04,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7dcb61de >2013-12-09 10:33:09,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f4e0952 >2013-12-09 10:33:10,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f4e0952 >2013-12-09 10:33:10,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 734640fa >2013-12-09 10:33:10,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 734640fa >2013-12-09 10:33:15,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17aaaf2f >2013-12-09 10:33:16,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 17aaaf2f >2013-12-09 10:33:16,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 724e6f7c >2013-12-09 10:33:16,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 724e6f7c >2013-12-09 10:33:21,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78e6b0e3 >2013-12-09 10:33:21,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 78e6b0e3 >2013-12-09 10:33:21,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f94245d >2013-12-09 10:33:22,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f94245d >2013-12-09 10:33:27,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6420e005 >2013-12-09 10:33:27,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6420e005 >2013-12-09 10:33:27,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75c7d305 >2013-12-09 10:33:27,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75c7d305 >2013-12-09 10:33:32,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 241b0269 >2013-12-09 10:33:33,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 241b0269 >2013-12-09 10:33:33,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75fb4f3 >2013-12-09 10:33:33,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75fb4f3 >2013-12-09 10:33:38,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 627cdd39 >2013-12-09 10:33:39,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 627cdd39 >2013-12-09 10:33:39,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69f8dc1d >2013-12-09 10:33:39,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69f8dc1d >2013-12-09 10:33:44,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50c4c6fb >2013-12-09 10:33:45,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 50c4c6fb >2013-12-09 10:33:45,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35e2b0ec >2013-12-09 10:33:45,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35e2b0ec >2013-12-09 10:33:50,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 493b0393 >2013-12-09 10:33:50,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 493b0393 >2013-12-09 10:33:50,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 566d129c >2013-12-09 10:33:51,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 566d129c >2013-12-09 10:33:55,999 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-7) No up server in cluster >2013-12-09 10:33:55,999 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-7) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:33:56,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3eaedef0 >2013-12-09 10:33:56,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f7dcd95 >2013-12-09 10:33:56,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3eaedef0 >2013-12-09 10:33:56,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f7dcd95 >2013-12-09 10:33:56,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c52c99c >2013-12-09 10:33:56,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c52c99c >2013-12-09 10:34:01,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11960e2e >2013-12-09 10:34:02,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 11960e2e >2013-12-09 10:34:02,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a4305de >2013-12-09 10:34:02,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a4305de >2013-12-09 10:34:07,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53b17bc8 >2013-12-09 10:34:08,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 53b17bc8 >2013-12-09 10:34:08,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ab9a73 >2013-12-09 10:34:08,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ab9a73 >2013-12-09 10:34:13,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48d80ad6 >2013-12-09 10:34:13,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 48d80ad6 >2013-12-09 10:34:13,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7432da7c >2013-12-09 10:34:14,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7432da7c >2013-12-09 10:34:19,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 44ba3c91 >2013-12-09 10:34:19,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 44ba3c91 >2013-12-09 10:34:19,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ec23bec >2013-12-09 10:34:20,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ec23bec >2013-12-09 10:34:25,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c89fdf2 >2013-12-09 10:34:25,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2c89fdf2 >2013-12-09 10:34:25,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6422862d >2013-12-09 10:34:25,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6422862d >2013-12-09 10:34:30,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28b1dfd4 >2013-12-09 10:34:31,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 28b1dfd4 >2013-12-09 10:34:31,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ebcdb64 >2013-12-09 10:34:31,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ebcdb64 >2013-12-09 10:34:36,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 25e35a61 >2013-12-09 10:34:37,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 25e35a61 >2013-12-09 10:34:37,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49e729b >2013-12-09 10:34:37,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49e729b >2013-12-09 10:34:42,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a96dce0 >2013-12-09 10:34:42,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a96dce0 >2013-12-09 10:34:42,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f00450f >2013-12-09 10:34:43,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f00450f >2013-12-09 10:34:48,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4aebcd5c >2013-12-09 10:34:48,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4aebcd5c >2013-12-09 10:34:48,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51196e3b >2013-12-09 10:34:48,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51196e3b >2013-12-09 10:34:53,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1226b8f1 >2013-12-09 10:34:54,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1226b8f1 >2013-12-09 10:34:54,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ed059b7 >2013-12-09 10:34:54,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ed059b7 >2013-12-09 10:34:56,287 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-1) No up server in cluster >2013-12-09 10:34:56,287 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-1) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:34:56,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d5b06d4 >2013-12-09 10:34:56,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4d5b06d4 >2013-12-09 10:34:59,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 179f165d >2013-12-09 10:35:00,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 179f165d >2013-12-09 10:35:00,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e9537d >2013-12-09 10:35:00,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e9537d >2013-12-09 10:35:05,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 512093ce >2013-12-09 10:35:06,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 512093ce >2013-12-09 10:35:06,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26e7ead7 >2013-12-09 10:35:06,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26e7ead7 >2013-12-09 10:35:11,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b806ad4 >2013-12-09 10:35:11,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b806ad4 >2013-12-09 10:35:11,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 168b15c5 >2013-12-09 10:35:12,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 168b15c5 >2013-12-09 10:35:17,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69db908f >2013-12-09 10:35:17,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 69db908f >2013-12-09 10:35:17,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3cda7c48 >2013-12-09 10:35:17,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3cda7c48 >2013-12-09 10:35:22,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 152daba7 >2013-12-09 10:35:23,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 152daba7 >2013-12-09 10:35:23,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4132d60a >2013-12-09 10:35:23,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4132d60a >2013-12-09 10:35:28,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6022568b >2013-12-09 10:35:29,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6022568b >2013-12-09 10:35:29,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b3e7090 >2013-12-09 10:35:29,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b3e7090 >2013-12-09 10:35:34,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 576e3380 >2013-12-09 10:35:34,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 576e3380 >2013-12-09 10:35:34,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71a00cfc >2013-12-09 10:35:35,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71a00cfc >2013-12-09 10:35:40,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a5a5284 >2013-12-09 10:35:40,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: a5a5284 >2013-12-09 10:35:40,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11bb06d6 >2013-12-09 10:35:40,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11bb06d6 >2013-12-09 10:35:46,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61547728 >2013-12-09 10:35:46,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 61547728 >2013-12-09 10:35:46,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12b1483a >2013-12-09 10:35:46,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12b1483a >2013-12-09 10:35:51,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 466cfe2d >2013-12-09 10:35:52,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 466cfe2d >2013-12-09 10:35:52,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6468b9da >2013-12-09 10:35:52,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6468b9da >2013-12-09 10:35:56,558 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-37) No up server in cluster >2013-12-09 10:35:56,558 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-37) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:35:56,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a8ae574 >2013-12-09 10:35:56,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3a8ae574 >2013-12-09 10:35:57,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d18501b >2013-12-09 10:35:58,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d18501b >2013-12-09 10:35:58,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58f767cc >2013-12-09 10:35:58,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58f767cc >2013-12-09 10:36:03,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ffb8b3f >2013-12-09 10:36:03,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ffb8b3f >2013-12-09 10:36:03,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e6869cd >2013-12-09 10:36:04,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e6869cd >2013-12-09 10:36:09,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ca9527a >2013-12-09 10:36:09,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ca9527a >2013-12-09 10:36:09,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8075ce5 >2013-12-09 10:36:09,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8075ce5 >2013-12-09 10:36:14,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 798002 >2013-12-09 10:36:15,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 798002 >2013-12-09 10:36:15,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a45194b >2013-12-09 10:36:16,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a45194b >2013-12-09 10:36:21,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7449ffd4 >2013-12-09 10:36:21,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7449ffd4 >2013-12-09 10:36:21,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ec31153 >2013-12-09 10:36:21,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ec31153 >2013-12-09 10:36:26,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b31b95a >2013-12-09 10:36:27,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: b31b95a >2013-12-09 10:36:27,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42f8ba79 >2013-12-09 10:36:27,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42f8ba79 >2013-12-09 10:36:32,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d02ce98 >2013-12-09 10:36:33,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: d02ce98 >2013-12-09 10:36:33,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29bcbd2 >2013-12-09 10:36:33,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29bcbd2 >2013-12-09 10:36:38,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f1c1fb9 >2013-12-09 10:36:38,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f1c1fb9 >2013-12-09 10:36:38,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f8e2b57 >2013-12-09 10:36:39,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f8e2b57 >2013-12-09 10:36:44,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2cc778be >2013-12-09 10:36:44,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2cc778be >2013-12-09 10:36:44,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b751c7a >2013-12-09 10:36:44,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b751c7a >2013-12-09 10:36:49,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 663b854e >2013-12-09 10:36:50,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 663b854e >2013-12-09 10:36:50,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fb5bdfc >2013-12-09 10:36:50,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2fb5bdfc >2013-12-09 10:36:55,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5905b7c6 >2013-12-09 10:36:56,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5905b7c6 >2013-12-09 10:36:56,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d7db559 >2013-12-09 10:36:56,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d7db559 >2013-12-09 10:36:56,837 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-53) No up server in cluster >2013-12-09 10:36:56,837 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-53) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:36:56,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d17c239 >2013-12-09 10:36:57,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1d17c239 >2013-12-09 10:37:01,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b9fa7cf >2013-12-09 10:37:01,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b9fa7cf >2013-12-09 10:37:01,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7094c >2013-12-09 10:37:02,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7094c >2013-12-09 10:37:07,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c6b9e0b >2013-12-09 10:37:07,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7c6b9e0b >2013-12-09 10:37:07,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b2e304e >2013-12-09 10:37:07,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b2e304e >2013-12-09 10:37:12,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6cfa2231 >2013-12-09 10:37:13,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6cfa2231 >2013-12-09 10:37:13,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44053cac >2013-12-09 10:37:13,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44053cac >2013-12-09 10:37:18,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fc3ef77 >2013-12-09 10:37:19,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2fc3ef77 >2013-12-09 10:37:19,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51e950aa >2013-12-09 10:37:19,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51e950aa >2013-12-09 10:37:24,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69e1c175 >2013-12-09 10:37:24,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 69e1c175 >2013-12-09 10:37:24,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d094f32 >2013-12-09 10:37:25,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d094f32 >2013-12-09 10:37:30,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69a81a8b >2013-12-09 10:37:30,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 69a81a8b >2013-12-09 10:37:30,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68c7d36b >2013-12-09 10:37:31,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68c7d36b >2013-12-09 10:37:36,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 526323d9 >2013-12-09 10:37:36,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 526323d9 >2013-12-09 10:37:36,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7766e963 >2013-12-09 10:37:36,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7766e963 >2013-12-09 10:37:41,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4760258b >2013-12-09 10:37:42,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4760258b >2013-12-09 10:37:42,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65444f4c >2013-12-09 10:37:42,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65444f4c >2013-12-09 10:37:47,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5864f13a >2013-12-09 10:37:48,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5864f13a >2013-12-09 10:37:48,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7be89303 >2013-12-09 10:37:48,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7be89303 >2013-12-09 10:37:53,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ad593cd >2013-12-09 10:37:53,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1ad593cd >2013-12-09 10:37:53,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a0f5b05 >2013-12-09 10:37:54,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a0f5b05 >2013-12-09 10:37:57,115 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2013-12-09 10:37:57,116 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:37:57,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 396ee413 >2013-12-09 10:37:57,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterTasksListVDSCommand, return: [], log id: 396ee413 >2013-12-09 10:37:59,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d2035ff >2013-12-09 10:37:59,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d2035ff >2013-12-09 10:37:59,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 369529fb >2013-12-09 10:37:59,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 369529fb >2013-12-09 10:38:04,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ef93f51 >2013-12-09 10:38:05,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7ef93f51 >2013-12-09 10:38:05,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4387bbd8 >2013-12-09 10:38:05,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4387bbd8 >2013-12-09 10:38:10,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e2cd609 >2013-12-09 10:38:11,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6e2cd609 >2013-12-09 10:38:11,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a9360d8 >2013-12-09 10:38:11,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a9360d8 >2013-12-09 10:38:16,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d92152d >2013-12-09 10:38:16,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4d92152d >2013-12-09 10:38:16,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 619a47ff >2013-12-09 10:38:17,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 619a47ff >2013-12-09 10:38:22,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4985d97 >2013-12-09 10:38:22,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4985d97 >2013-12-09 10:38:22,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d520ccc >2013-12-09 10:38:23,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d520ccc >2013-12-09 10:38:28,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74943f15 >2013-12-09 10:38:28,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 74943f15 >2013-12-09 10:38:28,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7afe81d2 >2013-12-09 10:38:28,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7afe81d2 >2013-12-09 10:38:33,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 440fdf0d >2013-12-09 10:38:34,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 440fdf0d >2013-12-09 10:38:34,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78a48737 >2013-12-09 10:38:34,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78a48737 >2013-12-09 10:38:39,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 666e76fe >2013-12-09 10:38:40,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 666e76fe >2013-12-09 10:38:40,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1221e963 >2013-12-09 10:38:40,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1221e963 >2013-12-09 10:38:45,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53761f0c >2013-12-09 10:38:45,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 53761f0c >2013-12-09 10:38:45,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38b6499f >2013-12-09 10:38:46,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38b6499f >2013-12-09 10:38:51,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 337f412 >2013-12-09 10:38:51,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 337f412 >2013-12-09 10:38:51,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 142ed61f >2013-12-09 10:38:51,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 142ed61f >2013-12-09 10:38:57,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bb9577c >2013-12-09 10:38:57,388 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-10) No up server in cluster >2013-12-09 10:38:57,388 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-10) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:38:57,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a82e2a1 >2013-12-09 10:38:57,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4bb9577c >2013-12-09 10:38:57,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d8f58ef >2013-12-09 10:38:57,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7a82e2a1 >2013-12-09 10:38:57,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d8f58ef >2013-12-09 10:39:02,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a48492d >2013-12-09 10:39:03,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4a48492d >2013-12-09 10:39:03,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37124f59 >2013-12-09 10:39:03,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37124f59 >2013-12-09 10:39:08,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c9aebd2 >2013-12-09 10:39:09,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1c9aebd2 >2013-12-09 10:39:09,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 405cd2d6 >2013-12-09 10:39:09,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 405cd2d6 >2013-12-09 10:39:14,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1aaf6312 >2013-12-09 10:39:14,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1aaf6312 >2013-12-09 10:39:14,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32c65421 >2013-12-09 10:39:15,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32c65421 >2013-12-09 10:39:20,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58a06b20 >2013-12-09 10:39:20,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 58a06b20 >2013-12-09 10:39:20,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d436cbb >2013-12-09 10:39:20,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d436cbb >2013-12-09 10:39:25,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64ee0037 >2013-12-09 10:39:26,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 64ee0037 >2013-12-09 10:39:26,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26298513 >2013-12-09 10:39:26,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26298513 >2013-12-09 10:39:31,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f8e75fc >2013-12-09 10:39:32,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f8e75fc >2013-12-09 10:39:32,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 485b514d >2013-12-09 10:39:32,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 485b514d >2013-12-09 10:39:37,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9c537e5 >2013-12-09 10:39:37,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 9c537e5 >2013-12-09 10:39:37,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 500742db >2013-12-09 10:39:38,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 500742db >2013-12-09 10:39:43,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e84b406 >2013-12-09 10:39:43,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4e84b406 >2013-12-09 10:39:43,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68a7dc28 >2013-12-09 10:39:44,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68a7dc28 >2013-12-09 10:39:49,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7aba0ecb >2013-12-09 10:39:49,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7aba0ecb >2013-12-09 10:39:49,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 684ae3c >2013-12-09 10:39:49,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 684ae3c >2013-12-09 10:39:54,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d9bf415 >2013-12-09 10:39:55,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d9bf415 >2013-12-09 10:39:55,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e24212c >2013-12-09 10:39:55,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e24212c >2013-12-09 10:39:57,666 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-92) No up server in cluster >2013-12-09 10:39:57,666 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-92) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:39:57,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4358e372 >2013-12-09 10:39:57,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4358e372 >2013-12-09 10:40:00,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64804218 >2013-12-09 10:40:01,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 64804218 >2013-12-09 10:40:01,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30b57b64 >2013-12-09 10:40:01,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30b57b64 >2013-12-09 10:40:06,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6fb41aab >2013-12-09 10:40:06,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6fb41aab >2013-12-09 10:40:06,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11bd4be7 >2013-12-09 10:40:07,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11bd4be7 >2013-12-09 10:40:12,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 721d027b >2013-12-09 10:40:12,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 721d027b >2013-12-09 10:40:12,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7538dc4e >2013-12-09 10:40:12,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7538dc4e >2013-12-09 10:40:17,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57e13452 >2013-12-09 10:40:18,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 57e13452 >2013-12-09 10:40:18,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6839fecd >2013-12-09 10:40:18,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6839fecd >2013-12-09 10:40:23,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6bc4b8d5 >2013-12-09 10:40:24,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6bc4b8d5 >2013-12-09 10:40:24,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75825418 >2013-12-09 10:40:24,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75825418 >2013-12-09 10:40:29,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 306e5607 >2013-12-09 10:40:30,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 306e5607 >2013-12-09 10:40:30,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b91bfa5 >2013-12-09 10:40:30,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b91bfa5 >2013-12-09 10:40:35,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29a4e650 >2013-12-09 10:40:35,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 29a4e650 >2013-12-09 10:40:35,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c5f30db >2013-12-09 10:40:36,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c5f30db >2013-12-09 10:40:41,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4fb0f954 >2013-12-09 10:40:41,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4fb0f954 >2013-12-09 10:40:41,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c6cf37d >2013-12-09 10:40:41,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c6cf37d >2013-12-09 10:40:46,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ccdf120 >2013-12-09 10:40:47,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ccdf120 >2013-12-09 10:40:47,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 762de516 >2013-12-09 10:40:47,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 762de516 >2013-12-09 10:40:52,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b5e2ef6 >2013-12-09 10:40:53,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6b5e2ef6 >2013-12-09 10:40:53,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18031bef >2013-12-09 10:40:53,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18031bef >2013-12-09 10:40:57,952 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-45) No up server in cluster >2013-12-09 10:40:57,952 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-45) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:40:57,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ced5044 >2013-12-09 10:40:58,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5ced5044 >2013-12-09 10:40:58,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1dc16682 >2013-12-09 10:40:58,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1dc16682 >2013-12-09 10:40:58,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2dddcb32 >2013-12-09 10:40:59,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2dddcb32 >2013-12-09 10:41:04,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b1c2e15 >2013-12-09 10:41:04,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: b1c2e15 >2013-12-09 10:41:04,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c66552a >2013-12-09 10:41:04,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c66552a >2013-12-09 10:41:10,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c31c87b >2013-12-09 10:41:10,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3c31c87b >2013-12-09 10:41:10,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d0fdec6 >2013-12-09 10:41:10,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d0fdec6 >2013-12-09 10:41:15,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f4480c3 >2013-12-09 10:41:16,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5f4480c3 >2013-12-09 10:41:16,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34958955 >2013-12-09 10:41:16,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34958955 >2013-12-09 10:41:21,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37583c75 >2013-12-09 10:41:22,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 37583c75 >2013-12-09 10:41:22,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 582af64f >2013-12-09 10:41:22,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 582af64f >2013-12-09 10:41:27,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1cfb78cf >2013-12-09 10:41:27,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1cfb78cf >2013-12-09 10:41:27,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e397fbf >2013-12-09 10:41:28,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e397fbf >2013-12-09 10:41:33,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60f92b5d >2013-12-09 10:41:33,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 60f92b5d >2013-12-09 10:41:33,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6cd767cb >2013-12-09 10:41:33,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6cd767cb >2013-12-09 10:41:38,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 615652b1 >2013-12-09 10:41:39,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 615652b1 >2013-12-09 10:41:39,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7234ee19 >2013-12-09 10:41:39,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7234ee19 >2013-12-09 10:41:44,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23bcbd0c >2013-12-09 10:41:45,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 23bcbd0c >2013-12-09 10:41:45,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 197fb589 >2013-12-09 10:41:45,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 197fb589 >2013-12-09 10:41:50,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 657c590b >2013-12-09 10:41:50,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 657c590b >2013-12-09 10:41:50,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7eb299d2 >2013-12-09 10:41:51,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7eb299d2 >2013-12-09 10:41:56,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 471223dc >2013-12-09 10:41:56,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 471223dc >2013-12-09 10:41:56,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28622824 >2013-12-09 10:41:57,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28622824 >2013-12-09 10:41:58,231 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-29) No up server in cluster >2013-12-09 10:41:58,231 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-29) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:41:58,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7010fda3 >2013-12-09 10:41:58,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7010fda3 >2013-12-09 10:42:02,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47b16210 >2013-12-09 10:42:02,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 47b16210 >2013-12-09 10:42:02,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b2585a9 >2013-12-09 10:42:02,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b2585a9 >2013-12-09 10:42:07,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c63610 >2013-12-09 10:42:08,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c63610 >2013-12-09 10:42:08,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18dcf1ba >2013-12-09 10:42:08,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18dcf1ba >2013-12-09 10:42:13,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20a14899 >2013-12-09 10:42:14,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 20a14899 >2013-12-09 10:42:14,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 439e6564 >2013-12-09 10:42:14,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 439e6564 >2013-12-09 10:42:19,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d865164 >2013-12-09 10:42:19,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: d865164 >2013-12-09 10:42:19,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57603f4b >2013-12-09 10:42:20,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57603f4b >2013-12-09 10:42:25,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f20a6ab >2013-12-09 10:42:25,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f20a6ab >2013-12-09 10:42:25,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e058bcd >2013-12-09 10:42:25,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e058bcd >2013-12-09 10:42:30,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 614c8864 >2013-12-09 10:42:31,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 614c8864 >2013-12-09 10:42:31,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d286a35 >2013-12-09 10:42:31,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d286a35 >2013-12-09 10:42:36,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74158404 >2013-12-09 10:42:37,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 74158404 >2013-12-09 10:42:37,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b998568 >2013-12-09 10:42:37,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b998568 >2013-12-09 10:42:42,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: be9993f >2013-12-09 10:42:42,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: be9993f >2013-12-09 10:42:42,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c26841e >2013-12-09 10:42:43,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c26841e >2013-12-09 10:42:48,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1356cac2 >2013-12-09 10:42:48,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1356cac2 >2013-12-09 10:42:48,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50a17cb4 >2013-12-09 10:42:48,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50a17cb4 >2013-12-09 10:42:54,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6fd12bd6 >2013-12-09 10:42:54,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6fd12bd6 >2013-12-09 10:42:54,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41218b83 >2013-12-09 10:42:54,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41218b83 >2013-12-09 10:42:58,527 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-88) No up server in cluster >2013-12-09 10:42:58,527 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-88) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:42:58,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ce14024 >2013-12-09 10:42:58,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4ce14024 >2013-12-09 10:42:59,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 428ffe85 >2013-12-09 10:43:00,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 428ffe85 >2013-12-09 10:43:00,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 223d294a >2013-12-09 10:43:00,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 223d294a >2013-12-09 10:43:05,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 716f90fb >2013-12-09 10:43:06,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 716f90fb >2013-12-09 10:43:06,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54a59b0a >2013-12-09 10:43:06,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54a59b0a >2013-12-09 10:43:11,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ee73cec >2013-12-09 10:43:11,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ee73cec >2013-12-09 10:43:11,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c87c927 >2013-12-09 10:43:12,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c87c927 >2013-12-09 10:43:17,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: cf0da2a >2013-12-09 10:43:17,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: cf0da2a >2013-12-09 10:43:17,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4207cf4f >2013-12-09 10:43:17,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4207cf4f >2013-12-09 10:43:22,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f13936f >2013-12-09 10:43:23,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f13936f >2013-12-09 10:43:23,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50591994 >2013-12-09 10:43:23,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50591994 >2013-12-09 10:43:28,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b5f8f45 >2013-12-09 10:43:29,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1b5f8f45 >2013-12-09 10:43:29,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ec5164e >2013-12-09 10:43:29,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ec5164e >2013-12-09 10:43:34,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 753d5aa0 >2013-12-09 10:43:34,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 753d5aa0 >2013-12-09 10:43:34,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 14f406ee >2013-12-09 10:43:35,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14f406ee >2013-12-09 10:43:40,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f9a9314 >2013-12-09 10:43:40,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f9a9314 >2013-12-09 10:43:40,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e24c0dd >2013-12-09 10:43:40,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e24c0dd >2013-12-09 10:43:46,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59300205 >2013-12-09 10:43:46,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 59300205 >2013-12-09 10:43:46,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50999e4 >2013-12-09 10:43:46,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50999e4 >2013-12-09 10:43:51,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d764937 >2013-12-09 10:43:52,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d764937 >2013-12-09 10:43:52,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3399d62 >2013-12-09 10:43:52,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3399d62 >2013-12-09 10:43:57,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a669955 >2013-12-09 10:43:58,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3a669955 >2013-12-09 10:43:58,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f4baa89 >2013-12-09 10:43:58,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f4baa89 >2013-12-09 10:43:58,822 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-49) No up server in cluster >2013-12-09 10:43:58,822 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-49) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:43:58,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ae882f5 >2013-12-09 10:43:59,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6ae882f5 >2013-12-09 10:44:03,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b6e649c >2013-12-09 10:44:03,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b6e649c >2013-12-09 10:44:03,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19809f73 >2013-12-09 10:44:04,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19809f73 >2013-12-09 10:44:09,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: baeb01b >2013-12-09 10:44:09,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: baeb01b >2013-12-09 10:44:09,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d6e5d37 >2013-12-09 10:44:09,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d6e5d37 >2013-12-09 10:44:14,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8359494 >2013-12-09 10:44:15,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 8359494 >2013-12-09 10:44:15,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67343863 >2013-12-09 10:44:15,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67343863 >2013-12-09 10:44:20,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 465211e8 >2013-12-09 10:44:21,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 465211e8 >2013-12-09 10:44:21,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a547ad9 >2013-12-09 10:44:21,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a547ad9 >2013-12-09 10:44:26,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1569982d >2013-12-09 10:44:27,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1569982d >2013-12-09 10:44:27,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12fb1506 >2013-12-09 10:44:27,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12fb1506 >2013-12-09 10:44:32,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1dab147a >2013-12-09 10:44:32,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1dab147a >2013-12-09 10:44:32,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8aa21ed >2013-12-09 10:44:33,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8aa21ed >2013-12-09 10:44:38,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f6bd8b6 >2013-12-09 10:44:38,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7f6bd8b6 >2013-12-09 10:44:38,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 688490ad >2013-12-09 10:44:38,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 688490ad >2013-12-09 10:44:43,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 447890b3 >2013-12-09 10:44:44,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 447890b3 >2013-12-09 10:44:44,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 22322524 >2013-12-09 10:44:44,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22322524 >2013-12-09 10:44:49,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 49a5c570 >2013-12-09 10:44:50,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 49a5c570 >2013-12-09 10:44:50,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e889f1d >2013-12-09 10:44:50,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e889f1d >2013-12-09 10:44:55,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ed1fb8c >2013-12-09 10:44:55,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5ed1fb8c >2013-12-09 10:44:55,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f679132 >2013-12-09 10:44:56,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f679132 >2013-12-09 10:44:59,099 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-30) No up server in cluster >2013-12-09 10:44:59,099 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-30) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:44:59,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 555cdac9 >2013-12-09 10:44:59,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterTasksListVDSCommand, return: [], log id: 555cdac9 >2013-12-09 10:45:01,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c9d6da7 >2013-12-09 10:45:01,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c9d6da7 >2013-12-09 10:45:01,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49b49eea >2013-12-09 10:45:01,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49b49eea >2013-12-09 10:45:06,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 191a79e0 >2013-12-09 10:45:07,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 191a79e0 >2013-12-09 10:45:07,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41d4f072 >2013-12-09 10:45:07,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41d4f072 >2013-12-09 10:45:12,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63ad3bed >2013-12-09 10:45:13,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 63ad3bed >2013-12-09 10:45:13,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c09814e >2013-12-09 10:45:13,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c09814e >2013-12-09 10:45:18,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ff9b65a >2013-12-09 10:45:19,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6ff9b65a >2013-12-09 10:45:19,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 543cdf3e >2013-12-09 10:45:19,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 543cdf3e >2013-12-09 10:45:24,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b81643a >2013-12-09 10:45:24,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b81643a >2013-12-09 10:45:24,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 92a7255 >2013-12-09 10:45:25,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 92a7255 >2013-12-09 10:45:30,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6571a45c >2013-12-09 10:45:30,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6571a45c >2013-12-09 10:45:30,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ab6f32 >2013-12-09 10:45:30,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ab6f32 >2013-12-09 10:45:35,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2edab992 >2013-12-09 10:45:36,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2edab992 >2013-12-09 10:45:36,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e037b40 >2013-12-09 10:45:36,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e037b40 >2013-12-09 10:45:41,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47a8a86a >2013-12-09 10:45:42,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 47a8a86a >2013-12-09 10:45:42,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d3eeef5 >2013-12-09 10:45:42,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d3eeef5 >2013-12-09 10:45:47,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6114bebe >2013-12-09 10:45:47,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6114bebe >2013-12-09 10:45:47,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64ae0652 >2013-12-09 10:45:48,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64ae0652 >2013-12-09 10:45:53,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 310bd6a8 >2013-12-09 10:45:53,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 310bd6a8 >2013-12-09 10:45:53,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39620ae9 >2013-12-09 10:45:53,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39620ae9 >2013-12-09 10:45:58,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 629aeb67 >2013-12-09 10:45:59,388 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-89) No up server in cluster >2013-12-09 10:45:59,388 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-89) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:45:59,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4da0f81e >2013-12-09 10:45:59,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 629aeb67 >2013-12-09 10:45:59,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14e18c15 >2013-12-09 10:45:59,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4da0f81e >2013-12-09 10:45:59,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14e18c15 >2013-12-09 10:46:04,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f5ec410 >2013-12-09 10:46:05,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f5ec410 >2013-12-09 10:46:05,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e4122d6 >2013-12-09 10:46:05,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e4122d6 >2013-12-09 10:46:10,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d969f3 >2013-12-09 10:46:11,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6d969f3 >2013-12-09 10:46:11,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 501f9161 >2013-12-09 10:46:11,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 501f9161 >2013-12-09 10:46:16,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a963fde >2013-12-09 10:46:16,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a963fde >2013-12-09 10:46:16,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46fd71c7 >2013-12-09 10:46:17,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46fd71c7 >2013-12-09 10:46:22,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1064833c >2013-12-09 10:46:22,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1064833c >2013-12-09 10:46:22,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1facd116 >2013-12-09 10:46:22,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1facd116 >2013-12-09 10:46:27,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68af5fa >2013-12-09 10:46:28,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 68af5fa >2013-12-09 10:46:28,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f2ded98 >2013-12-09 10:46:28,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f2ded98 >2013-12-09 10:46:33,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74279f7c >2013-12-09 10:46:34,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 74279f7c >2013-12-09 10:46:34,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77733581 >2013-12-09 10:46:34,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77733581 >2013-12-09 10:46:39,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bd6c035 >2013-12-09 10:46:40,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1bd6c035 >2013-12-09 10:46:40,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1991f6b8 >2013-12-09 10:46:40,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1991f6b8 >2013-12-09 10:46:45,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e42f2a3 >2013-12-09 10:46:45,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7e42f2a3 >2013-12-09 10:46:45,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 315d8ea0 >2013-12-09 10:46:46,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 315d8ea0 >2013-12-09 10:46:51,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f74f532 >2013-12-09 10:46:51,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f74f532 >2013-12-09 10:46:51,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18661371 >2013-12-09 10:46:51,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18661371 >2013-12-09 10:46:56,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18e9d731 >2013-12-09 10:46:57,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 18e9d731 >2013-12-09 10:46:57,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f5fd03e >2013-12-09 10:46:57,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f5fd03e >2013-12-09 10:46:59,681 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-96) No up server in cluster >2013-12-09 10:46:59,681 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-96) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:46:59,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 213fe7fa >2013-12-09 10:46:59,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterTasksListVDSCommand, return: [], log id: 213fe7fa >2013-12-09 10:47:02,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7888d8ef >2013-12-09 10:47:03,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7888d8ef >2013-12-09 10:47:03,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6752a8f4 >2013-12-09 10:47:03,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6752a8f4 >2013-12-09 10:47:08,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2df9ce32 >2013-12-09 10:47:08,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2df9ce32 >2013-12-09 10:47:08,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c5cf458 >2013-12-09 10:47:09,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c5cf458 >2013-12-09 10:47:14,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7cf38d9 >2013-12-09 10:47:14,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7cf38d9 >2013-12-09 10:47:14,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ea4a170 >2013-12-09 10:47:14,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ea4a170 >2013-12-09 10:47:19,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c4a2281 >2013-12-09 10:47:20,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7c4a2281 >2013-12-09 10:47:20,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e93293 >2013-12-09 10:47:20,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e93293 >2013-12-09 10:47:25,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e7c5c1a >2013-12-09 10:47:26,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e7c5c1a >2013-12-09 10:47:26,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 438bacdc >2013-12-09 10:47:26,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 438bacdc >2013-12-09 10:47:31,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4eaa1902 >2013-12-09 10:47:31,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4eaa1902 >2013-12-09 10:47:31,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 22a58e18 >2013-12-09 10:47:32,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22a58e18 >2013-12-09 10:47:37,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48f9257e >2013-12-09 10:47:37,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 48f9257e >2013-12-09 10:47:37,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3273616d >2013-12-09 10:47:38,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3273616d >2013-12-09 10:47:43,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1bc55800 >2013-12-09 10:47:43,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1bc55800 >2013-12-09 10:47:43,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69b08597 >2013-12-09 10:47:43,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69b08597 >2013-12-09 10:47:48,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 87220bc >2013-12-09 10:47:49,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 87220bc >2013-12-09 10:47:49,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 372bb57d >2013-12-09 10:47:49,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 372bb57d >2013-12-09 10:47:54,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46751425 >2013-12-09 10:47:55,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 46751425 >2013-12-09 10:47:55,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6216c43b >2013-12-09 10:47:55,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6216c43b >2013-12-09 10:47:59,967 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-34) No up server in cluster >2013-12-09 10:47:59,967 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-34) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:47:59,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: df374d8 >2013-12-09 10:48:00,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterTasksListVDSCommand, return: [], log id: df374d8 >2013-12-09 10:48:00,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7772edfb >2013-12-09 10:48:00,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7772edfb >2013-12-09 10:48:00,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4abb6903 >2013-12-09 10:48:01,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4abb6903 >2013-12-09 10:48:06,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d6cfdc8 >2013-12-09 10:48:06,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d6cfdc8 >2013-12-09 10:48:06,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73497ecd >2013-12-09 10:48:06,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73497ecd >2013-12-09 10:48:11,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2246c3e >2013-12-09 10:48:12,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2246c3e >2013-12-09 10:48:12,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 625e2204 >2013-12-09 10:48:12,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 625e2204 >2013-12-09 10:48:17,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39e6acd0 >2013-12-09 10:48:18,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 39e6acd0 >2013-12-09 10:48:18,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2073e0b9 >2013-12-09 10:48:18,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2073e0b9 >2013-12-09 10:48:23,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4469dd50 >2013-12-09 10:48:24,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4469dd50 >2013-12-09 10:48:24,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a5e11db >2013-12-09 10:48:24,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a5e11db >2013-12-09 10:48:29,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f4f81ae >2013-12-09 10:48:29,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7f4f81ae >2013-12-09 10:48:29,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 705e4308 >2013-12-09 10:48:30,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 705e4308 >2013-12-09 10:48:35,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ecc36c2 >2013-12-09 10:48:35,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ecc36c2 >2013-12-09 10:48:35,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 764122ff >2013-12-09 10:48:35,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 764122ff >2013-12-09 10:48:40,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d2c931f >2013-12-09 10:48:41,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d2c931f >2013-12-09 10:48:41,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7abe9044 >2013-12-09 10:48:41,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7abe9044 >2013-12-09 10:48:46,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68a20968 >2013-12-09 10:48:47,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 68a20968 >2013-12-09 10:48:47,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 414f2c27 >2013-12-09 10:48:47,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 414f2c27 >2013-12-09 10:48:52,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52abdf85 >2013-12-09 10:48:52,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 52abdf85 >2013-12-09 10:48:52,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5eaa07cc >2013-12-09 10:48:53,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5eaa07cc >2013-12-09 10:48:58,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7217d190 >2013-12-09 10:48:58,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7217d190 >2013-12-09 10:48:58,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b549f7e >2013-12-09 10:48:58,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b549f7e >2013-12-09 10:49:00,239 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-79) No up server in cluster >2013-12-09 10:49:00,239 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-79) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:49:00,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53c4f294 >2013-12-09 10:49:00,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterTasksListVDSCommand, return: [], log id: 53c4f294 >2013-12-09 10:49:03,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49301374 >2013-12-09 10:49:04,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 49301374 >2013-12-09 10:49:04,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a7c2408 >2013-12-09 10:49:04,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a7c2408 >2013-12-09 10:49:09,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a8dc4e2 >2013-12-09 10:49:10,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: a8dc4e2 >2013-12-09 10:49:10,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c5d1303 >2013-12-09 10:49:10,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c5d1303 >2013-12-09 10:49:15,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c80d917 >2013-12-09 10:49:16,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7c80d917 >2013-12-09 10:49:16,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e40fb04 >2013-12-09 10:49:16,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e40fb04 >2013-12-09 10:49:21,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58189f29 >2013-12-09 10:49:21,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 58189f29 >2013-12-09 10:49:21,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 398049cf >2013-12-09 10:49:22,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 398049cf >2013-12-09 10:49:27,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10c23d61 >2013-12-09 10:49:27,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 10c23d61 >2013-12-09 10:49:27,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c3008ac >2013-12-09 10:49:27,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c3008ac >2013-12-09 10:49:32,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 650b63ed >2013-12-09 10:49:33,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 650b63ed >2013-12-09 10:49:33,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1eea470e >2013-12-09 10:49:33,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1eea470e >2013-12-09 10:49:38,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 719adef0 >2013-12-09 10:49:39,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 719adef0 >2013-12-09 10:49:39,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2dd1559e >2013-12-09 10:49:39,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2dd1559e >2013-12-09 10:49:44,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c322f96 >2013-12-09 10:49:44,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2c322f96 >2013-12-09 10:49:44,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d02444e >2013-12-09 10:49:45,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d02444e >2013-12-09 10:49:50,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 89c3630 >2013-12-09 10:49:50,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 89c3630 >2013-12-09 10:49:50,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32509c2c >2013-12-09 10:49:50,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32509c2c >2013-12-09 10:49:55,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a6641b0 >2013-12-09 10:49:56,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a6641b0 >2013-12-09 10:49:56,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3076910 >2013-12-09 10:49:56,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3076910 >2013-12-09 10:50:00,508 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-12) No up server in cluster >2013-12-09 10:50:00,508 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-12) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:50:00,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 442e5c20 >2013-12-09 10:50:00,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterTasksListVDSCommand, return: [], log id: 442e5c20 >2013-12-09 10:50:01,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c60abb5 >2013-12-09 10:50:02,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c60abb5 >2013-12-09 10:50:02,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 450eb80a >2013-12-09 10:50:02,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 450eb80a >2013-12-09 10:50:07,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5af75e6 >2013-12-09 10:50:08,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5af75e6 >2013-12-09 10:50:08,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a4676c9 >2013-12-09 10:50:08,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a4676c9 >2013-12-09 10:50:13,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7959c0f6 >2013-12-09 10:50:13,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7959c0f6 >2013-12-09 10:50:13,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5007d276 >2013-12-09 10:50:14,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5007d276 >2013-12-09 10:50:19,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d50e37a >2013-12-09 10:50:19,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5d50e37a >2013-12-09 10:50:19,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c4319f4 >2013-12-09 10:50:19,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c4319f4 >2013-12-09 10:50:24,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65fb0db2 >2013-12-09 10:50:25,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 65fb0db2 >2013-12-09 10:50:25,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c13fa5c >2013-12-09 10:50:25,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c13fa5c >2013-12-09 10:50:30,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 772af67b >2013-12-09 10:50:31,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 772af67b >2013-12-09 10:50:31,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f4b333 >2013-12-09 10:50:31,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f4b333 >2013-12-09 10:50:36,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77aa33ab >2013-12-09 10:50:36,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 77aa33ab >2013-12-09 10:50:36,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f15af81 >2013-12-09 10:50:37,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f15af81 >2013-12-09 10:50:42,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7203ad69 >2013-12-09 10:50:42,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7203ad69 >2013-12-09 10:50:42,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 609e401b >2013-12-09 10:50:42,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 609e401b >2013-12-09 10:50:47,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 533c4d7e >2013-12-09 10:50:48,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 533c4d7e >2013-12-09 10:50:48,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7eddff00 >2013-12-09 10:50:48,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7eddff00 >2013-12-09 10:50:53,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64177885 >2013-12-09 10:50:54,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 64177885 >2013-12-09 10:50:54,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10cc7a19 >2013-12-09 10:50:54,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10cc7a19 >2013-12-09 10:50:59,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d0c6156 >2013-12-09 10:50:59,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2d0c6156 >2013-12-09 10:50:59,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f4a4929 >2013-12-09 10:51:00,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f4a4929 >2013-12-09 10:51:00,789 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-75) No up server in cluster >2013-12-09 10:51:00,790 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-75) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:51:00,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3eb5a826 >2013-12-09 10:51:01,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3eb5a826 >2013-12-09 10:51:05,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 476fabc3 >2013-12-09 10:51:05,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 476fabc3 >2013-12-09 10:51:05,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58b90262 >2013-12-09 10:51:06,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58b90262 >2013-12-09 10:51:11,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 471e174 >2013-12-09 10:51:11,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 471e174 >2013-12-09 10:51:11,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53a980e0 >2013-12-09 10:51:11,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53a980e0 >2013-12-09 10:51:16,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27311b5f >2013-12-09 10:51:17,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 27311b5f >2013-12-09 10:51:17,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64b09741 >2013-12-09 10:51:17,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64b09741 >2013-12-09 10:51:22,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c13237 >2013-12-09 10:51:23,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c13237 >2013-12-09 10:51:23,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65a362e2 >2013-12-09 10:51:23,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65a362e2 >2013-12-09 10:51:28,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 666e4f84 >2013-12-09 10:51:28,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 666e4f84 >2013-12-09 10:51:28,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f41b079 >2013-12-09 10:51:29,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f41b079 >2013-12-09 10:51:34,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50de7a57 >2013-12-09 10:51:34,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 50de7a57 >2013-12-09 10:51:34,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 379eeedb >2013-12-09 10:51:34,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 379eeedb >2013-12-09 10:51:39,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77bfaecf >2013-12-09 10:51:40,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 77bfaecf >2013-12-09 10:51:40,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17319a34 >2013-12-09 10:51:40,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17319a34 >2013-12-09 10:51:45,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f6d8217 >2013-12-09 10:51:46,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1f6d8217 >2013-12-09 10:51:46,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f149139 >2013-12-09 10:51:46,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f149139 >2013-12-09 10:51:51,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66c68fa0 >2013-12-09 10:51:51,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 66c68fa0 >2013-12-09 10:51:51,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4687fe83 >2013-12-09 10:51:52,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4687fe83 >2013-12-09 10:51:57,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: fa8fb3d >2013-12-09 10:51:57,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: fa8fb3d >2013-12-09 10:51:57,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3677aff4 >2013-12-09 10:51:58,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3677aff4 >2013-12-09 10:52:01,084 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-14) No up server in cluster >2013-12-09 10:52:01,084 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-14) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:52:01,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c643f32 >2013-12-09 10:52:01,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterTasksListVDSCommand, return: [], log id: c643f32 >2013-12-09 10:52:03,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33187e12 >2013-12-09 10:52:03,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 33187e12 >2013-12-09 10:52:03,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11a071b8 >2013-12-09 10:52:03,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11a071b8 >2013-12-09 10:52:08,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 690054dc >2013-12-09 10:52:09,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 690054dc >2013-12-09 10:52:09,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3552800b >2013-12-09 10:52:09,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3552800b >2013-12-09 10:52:14,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6fe73905 >2013-12-09 10:52:15,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6fe73905 >2013-12-09 10:52:15,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a43622b >2013-12-09 10:52:15,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a43622b >2013-12-09 10:52:20,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bb814ef >2013-12-09 10:52:20,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4bb814ef >2013-12-09 10:52:20,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48380bfb >2013-12-09 10:52:21,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48380bfb >2013-12-09 10:52:26,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2917f49 >2013-12-09 10:52:26,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2917f49 >2013-12-09 10:52:26,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7eafbcc >2013-12-09 10:52:26,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7eafbcc >2013-12-09 10:52:31,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d6ff12d >2013-12-09 10:52:32,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6d6ff12d >2013-12-09 10:52:32,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c8e8bdb >2013-12-09 10:52:32,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c8e8bdb >2013-12-09 10:52:37,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ceba6de >2013-12-09 10:52:38,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: ceba6de >2013-12-09 10:52:38,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1df5e330 >2013-12-09 10:52:38,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1df5e330 >2013-12-09 10:52:43,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 309c799a >2013-12-09 10:52:44,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 309c799a >2013-12-09 10:52:44,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 183d5c6 >2013-12-09 10:52:44,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 183d5c6 >2013-12-09 10:52:49,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66bc025c >2013-12-09 10:52:49,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 66bc025c >2013-12-09 10:52:49,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 469a9202 >2013-12-09 10:52:50,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 469a9202 >2013-12-09 10:52:55,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ec96a84 >2013-12-09 10:52:55,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ec96a84 >2013-12-09 10:52:55,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d95cdd4 >2013-12-09 10:52:55,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d95cdd4 >2013-12-09 10:53:00,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1361d6ca >2013-12-09 10:53:01,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1361d6ca >2013-12-09 10:53:01,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d4e8e73 >2013-12-09 10:53:01,369 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-11) No up server in cluster >2013-12-09 10:53:01,369 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-11) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:53:01,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59585c6 >2013-12-09 10:53:01,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d4e8e73 >2013-12-09 10:53:01,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterTasksListVDSCommand, return: [], log id: 59585c6 >2013-12-09 10:53:06,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62b32a2d >2013-12-09 10:53:07,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 62b32a2d >2013-12-09 10:53:07,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48a16d9e >2013-12-09 10:53:07,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48a16d9e >2013-12-09 10:53:12,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46f03375 >2013-12-09 10:53:12,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 46f03375 >2013-12-09 10:53:12,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 334f842c >2013-12-09 10:53:13,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 334f842c >2013-12-09 10:53:18,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 268178c0 >2013-12-09 10:53:18,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 268178c0 >2013-12-09 10:53:18,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59d20730 >2013-12-09 10:53:18,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59d20730 >2013-12-09 10:53:23,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e18d325 >2013-12-09 10:53:24,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7e18d325 >2013-12-09 10:53:24,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d54be79 >2013-12-09 10:53:24,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d54be79 >2013-12-09 10:53:29,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e1bcc82 >2013-12-09 10:53:30,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6e1bcc82 >2013-12-09 10:53:30,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65c17a8c >2013-12-09 10:53:30,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65c17a8c >2013-12-09 10:53:35,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d50041a >2013-12-09 10:53:36,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6d50041a >2013-12-09 10:53:36,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c12682e >2013-12-09 10:53:36,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c12682e >2013-12-09 10:53:41,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d11252c >2013-12-09 10:53:41,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: d11252c >2013-12-09 10:53:41,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 156d95cc >2013-12-09 10:53:42,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 156d95cc >2013-12-09 10:53:47,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 564c71be >2013-12-09 10:53:47,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 564c71be >2013-12-09 10:53:47,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ed2118f >2013-12-09 10:53:47,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ed2118f >2013-12-09 10:53:52,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6750370f >2013-12-09 10:53:53,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6750370f >2013-12-09 10:53:53,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4fa6f1c2 >2013-12-09 10:53:53,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fa6f1c2 >2013-12-09 10:53:58,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: db27da4 >2013-12-09 10:53:59,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: db27da4 >2013-12-09 10:53:59,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e83d849 >2013-12-09 10:53:59,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e83d849 >2013-12-09 10:54:01,645 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-69) No up server in cluster >2013-12-09 10:54:01,645 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-69) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:54:01,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 502fde6c >2013-12-09 10:54:01,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterTasksListVDSCommand, return: [], log id: 502fde6c >2013-12-09 10:54:04,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6453e538 >2013-12-09 10:54:04,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6453e538 >2013-12-09 10:54:04,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: cb5b7f1 >2013-12-09 10:54:05,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: cb5b7f1 >2013-12-09 10:54:10,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 834f02e >2013-12-09 10:54:10,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 834f02e >2013-12-09 10:54:10,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2052cad3 >2013-12-09 10:54:10,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2052cad3 >2013-12-09 10:54:15,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32c4b75 >2013-12-09 10:54:16,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 32c4b75 >2013-12-09 10:54:16,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 626bc533 >2013-12-09 10:54:16,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 626bc533 >2013-12-09 10:54:21,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3cf77048 >2013-12-09 10:54:22,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3cf77048 >2013-12-09 10:54:22,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 534a0f1f >2013-12-09 10:54:22,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 534a0f1f >2013-12-09 10:54:27,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d071b9d >2013-12-09 10:54:28,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: d071b9d >2013-12-09 10:54:28,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f530f70 >2013-12-09 10:54:28,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f530f70 >2013-12-09 10:54:33,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33687410 >2013-12-09 10:54:33,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 33687410 >2013-12-09 10:54:33,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12882446 >2013-12-09 10:54:34,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12882446 >2013-12-09 10:54:39,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 147f54e2 >2013-12-09 10:54:39,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 147f54e2 >2013-12-09 10:54:39,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2990b4b9 >2013-12-09 10:54:39,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2990b4b9 >2013-12-09 10:54:44,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 692d19a1 >2013-12-09 10:54:45,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 692d19a1 >2013-12-09 10:54:45,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47310e7 >2013-12-09 10:54:45,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47310e7 >2013-12-09 10:54:50,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63fe375f >2013-12-09 10:54:51,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 63fe375f >2013-12-09 10:54:51,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d05506a >2013-12-09 10:54:51,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d05506a >2013-12-09 10:54:56,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b57a961 >2013-12-09 10:54:56,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b57a961 >2013-12-09 10:54:56,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f04a084 >2013-12-09 10:54:57,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f04a084 >2013-12-09 10:55:01,937 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-35) No up server in cluster >2013-12-09 10:55:01,937 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-35) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:55:01,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7963b4e9 >2013-12-09 10:55:02,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7963b4e9 >2013-12-09 10:55:02,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 448818ff >2013-12-09 10:55:02,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 448818ff >2013-12-09 10:55:02,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9bdd89e >2013-12-09 10:55:03,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9bdd89e >2013-12-09 10:55:08,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33e8e102 >2013-12-09 10:55:08,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 33e8e102 >2013-12-09 10:55:08,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45cbae9 >2013-12-09 10:55:08,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45cbae9 >2013-12-09 10:55:13,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 625e0206 >2013-12-09 10:55:14,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 625e0206 >2013-12-09 10:55:14,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7178e783 >2013-12-09 10:55:14,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7178e783 >2013-12-09 10:55:19,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c099037 >2013-12-09 10:55:20,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c099037 >2013-12-09 10:55:20,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ff1acd6 >2013-12-09 10:55:20,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ff1acd6 >2013-12-09 10:55:25,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71e743d9 >2013-12-09 10:55:25,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 71e743d9 >2013-12-09 10:55:25,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1145a230 >2013-12-09 10:55:26,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1145a230 >2013-12-09 10:55:31,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62f45ed8 >2013-12-09 10:55:31,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 62f45ed8 >2013-12-09 10:55:31,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bd9e392 >2013-12-09 10:55:31,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1bd9e392 >2013-12-09 10:55:36,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 590b626d >2013-12-09 10:55:37,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 590b626d >2013-12-09 10:55:37,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 204fddf >2013-12-09 10:55:37,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 204fddf >2013-12-09 10:55:42,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 44f6106d >2013-12-09 10:55:43,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 44f6106d >2013-12-09 10:55:43,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78dc5a5 >2013-12-09 10:55:43,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78dc5a5 >2013-12-09 10:55:48,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40fb68b1 >2013-12-09 10:55:49,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 40fb68b1 >2013-12-09 10:55:49,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31650177 >2013-12-09 10:55:49,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31650177 >2013-12-09 10:55:54,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76adc9c4 >2013-12-09 10:55:54,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 76adc9c4 >2013-12-09 10:55:54,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c28f41 >2013-12-09 10:55:55,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c28f41 >2013-12-09 10:56:00,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2abf0b88 >2013-12-09 10:56:00,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2abf0b88 >2013-12-09 10:56:00,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6144e1be >2013-12-09 10:56:00,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6144e1be >2013-12-09 10:56:02,209 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-56) No up server in cluster >2013-12-09 10:56:02,209 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-56) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:56:02,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 307e4c65 >2013-12-09 10:56:02,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterTasksListVDSCommand, return: [], log id: 307e4c65 >2013-12-09 10:56:05,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23793e92 >2013-12-09 10:56:06,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 23793e92 >2013-12-09 10:56:06,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2522469f >2013-12-09 10:56:06,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2522469f >2013-12-09 10:56:11,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76683176 >2013-12-09 10:56:12,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 76683176 >2013-12-09 10:56:12,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36614ff4 >2013-12-09 10:56:12,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36614ff4 >2013-12-09 10:56:17,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43b99dac >2013-12-09 10:56:17,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 43b99dac >2013-12-09 10:56:17,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ac8756a >2013-12-09 10:56:18,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ac8756a >2013-12-09 10:56:23,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 611a50f0 >2013-12-09 10:56:23,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 611a50f0 >2013-12-09 10:56:23,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62b0fc6a >2013-12-09 10:56:23,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62b0fc6a >2013-12-09 10:56:28,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2924b488 >2013-12-09 10:56:29,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2924b488 >2013-12-09 10:56:29,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78714527 >2013-12-09 10:56:29,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78714527 >2013-12-09 10:56:34,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f62c8a >2013-12-09 10:56:35,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5f62c8a >2013-12-09 10:56:35,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68d84213 >2013-12-09 10:56:35,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68d84213 >2013-12-09 10:56:40,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 476a8911 >2013-12-09 10:56:41,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 476a8911 >2013-12-09 10:56:41,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31a01ac2 >2013-12-09 10:56:41,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31a01ac2 >2013-12-09 10:56:46,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3693d13e >2013-12-09 10:56:46,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3693d13e >2013-12-09 10:56:46,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4822a6dd >2013-12-09 10:56:47,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4822a6dd >2013-12-09 10:56:52,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9050ecc >2013-12-09 10:56:52,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 9050ecc >2013-12-09 10:56:52,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64899a84 >2013-12-09 10:56:52,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64899a84 >2013-12-09 10:56:57,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2eb0b1cd >2013-12-09 10:56:58,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2eb0b1cd >2013-12-09 10:56:58,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10785e40 >2013-12-09 10:56:58,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10785e40 >2013-12-09 10:57:02,497 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-15) No up server in cluster >2013-12-09 10:57:02,497 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-15) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:57:02,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35e8d891 >2013-12-09 10:57:02,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterTasksListVDSCommand, return: [], log id: 35e8d891 >2013-12-09 10:57:03,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6044c7ff >2013-12-09 10:57:04,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6044c7ff >2013-12-09 10:57:04,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52bc4973 >2013-12-09 10:57:04,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52bc4973 >2013-12-09 10:57:09,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3cdb2474 >2013-12-09 10:57:09,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3cdb2474 >2013-12-09 10:57:09,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 291dd1aa >2013-12-09 10:57:10,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 291dd1aa >2013-12-09 10:57:15,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d49ced8 >2013-12-09 10:57:15,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d49ced8 >2013-12-09 10:57:15,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35e9c00c >2013-12-09 10:57:15,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35e9c00c >2013-12-09 10:57:21,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d5e050b >2013-12-09 10:57:21,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d5e050b >2013-12-09 10:57:21,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ec3bb85 >2013-12-09 10:57:21,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ec3bb85 >2013-12-09 10:57:26,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 630d97a7 >2013-12-09 10:57:27,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 630d97a7 >2013-12-09 10:57:27,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2606c8f7 >2013-12-09 10:57:27,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2606c8f7 >2013-12-09 10:57:32,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63559d18 >2013-12-09 10:57:33,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 63559d18 >2013-12-09 10:57:33,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f6d814c >2013-12-09 10:57:33,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f6d814c >2013-12-09 10:57:38,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 196a42c2 >2013-12-09 10:57:38,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 196a42c2 >2013-12-09 10:57:38,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 580a776a >2013-12-09 10:57:39,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 580a776a >2013-12-09 10:57:44,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5da813c9 >2013-12-09 10:57:44,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5da813c9 >2013-12-09 10:57:44,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f2b5c59 >2013-12-09 10:57:44,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f2b5c59 >2013-12-09 10:57:49,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7eb67dae >2013-12-09 10:57:50,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7eb67dae >2013-12-09 10:57:50,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52c28c41 >2013-12-09 10:57:50,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52c28c41 >2013-12-09 10:57:55,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3758977c >2013-12-09 10:57:56,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3758977c >2013-12-09 10:57:56,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 218c4115 >2013-12-09 10:57:56,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 218c4115 >2013-12-09 10:58:01,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74afcddb >2013-12-09 10:58:01,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 74afcddb >2013-12-09 10:58:01,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35ad790e >2013-12-09 10:58:02,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35ad790e >2013-12-09 10:58:02,767 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-57) No up server in cluster >2013-12-09 10:58:02,768 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-57) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:58:02,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e344311 >2013-12-09 10:58:03,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6e344311 >2013-12-09 10:58:07,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59207cbf >2013-12-09 10:58:07,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 59207cbf >2013-12-09 10:58:07,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21827d02 >2013-12-09 10:58:08,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21827d02 >2013-12-09 10:58:13,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3dddfdc3 >2013-12-09 10:58:13,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3dddfdc3 >2013-12-09 10:58:13,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37c0814 >2013-12-09 10:58:13,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37c0814 >2013-12-09 10:58:18,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5da22ec0 >2013-12-09 10:58:19,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5da22ec0 >2013-12-09 10:58:19,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d07d228 >2013-12-09 10:58:19,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d07d228 >2013-12-09 10:58:24,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a631623 >2013-12-09 10:58:25,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a631623 >2013-12-09 10:58:25,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6dcfae2 >2013-12-09 10:58:25,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6dcfae2 >2013-12-09 10:58:30,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34f08abe >2013-12-09 10:58:30,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 34f08abe >2013-12-09 10:58:30,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 569bd8de >2013-12-09 10:58:31,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 569bd8de >2013-12-09 10:58:36,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 98d7567 >2013-12-09 10:58:36,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 98d7567 >2013-12-09 10:58:36,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 354bacb1 >2013-12-09 10:58:36,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 354bacb1 >2013-12-09 10:58:41,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66284452 >2013-12-09 10:58:42,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 66284452 >2013-12-09 10:58:42,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d322b35 >2013-12-09 10:58:42,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d322b35 >2013-12-09 10:58:47,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4fc752f >2013-12-09 10:58:48,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4fc752f >2013-12-09 10:58:48,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 618913b5 >2013-12-09 10:58:48,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 618913b5 >2013-12-09 10:58:53,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 513b6853 >2013-12-09 10:58:54,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 513b6853 >2013-12-09 10:58:54,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 217a26b8 >2013-12-09 10:58:54,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 217a26b8 >2013-12-09 10:58:59,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72939f8d >2013-12-09 10:58:59,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 72939f8d >2013-12-09 10:58:59,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29f9e4ca >2013-12-09 10:59:00,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29f9e4ca >2013-12-09 10:59:03,044 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-2) No up server in cluster >2013-12-09 10:59:03,044 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-2) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 10:59:03,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a0b53e8 >2013-12-09 10:59:03,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1a0b53e8 >2013-12-09 10:59:05,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 606e3edc >2013-12-09 10:59:05,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 606e3edc >2013-12-09 10:59:05,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 242e6764 >2013-12-09 10:59:05,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 242e6764 >2013-12-09 10:59:10,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fb9bb85 >2013-12-09 10:59:11,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7fb9bb85 >2013-12-09 10:59:11,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5cd5fa83 >2013-12-09 10:59:11,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cd5fa83 >2013-12-09 10:59:16,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 49e3317d >2013-12-09 10:59:17,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 49e3317d >2013-12-09 10:59:17,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a3fbc2e >2013-12-09 10:59:17,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a3fbc2e >2013-12-09 10:59:22,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24b80036 >2013-12-09 10:59:22,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 24b80036 >2013-12-09 10:59:22,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a43056c >2013-12-09 10:59:23,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a43056c >2013-12-09 10:59:28,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ecac558 >2013-12-09 10:59:28,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2ecac558 >2013-12-09 10:59:28,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e2f344f >2013-12-09 10:59:28,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e2f344f >2013-12-09 10:59:34,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60f77475 >2013-12-09 10:59:34,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 60f77475 >2013-12-09 10:59:34,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60d629c5 >2013-12-09 10:59:34,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60d629c5 >2013-12-09 10:59:38,745 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-75) Attempting to update VMs/Templates Ovf. >2013-12-09 10:59:39,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19675f7d >2013-12-09 10:59:40,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-48) START, GlusterHooksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67e12555 >2013-12-09 10:59:40,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-47) START, GlusterHooksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7cbd2d2d >2013-12-09 10:59:40,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-47) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@55b61afc, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@1764dc67, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@9c2ef002, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@27b5c03d, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@e9e2b838, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@3dc2a1b, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@6f9ae332], log id: 7cbd2d2d >2013-12-09 10:59:40,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-48) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@cbc880cd, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@6f9767da, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@4b7f34b4, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@4db7364d, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@de66b95a, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@f0dc1206, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@c702d646], log id: 67e12555 >2013-12-09 10:59:40,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19675f7d >2013-12-09 10:59:40,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17d6bd11 >2013-12-09 10:59:40,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17d6bd11 >2013-12-09 10:59:44,541 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-82) Start refreshing all users data >2013-12-09 10:59:44,583 WARN [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-82) Inactive User rhsc_user1 found in directory server, its status switched to Active >2013-12-09 10:59:45,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65ece4b1 >2013-12-09 10:59:46,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 65ece4b1 >2013-12-09 10:59:46,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4212b2ef >2013-12-09 10:59:46,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4212b2ef >2013-12-09 10:59:51,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44b02ecd >2013-12-09 10:59:51,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 44b02ecd >2013-12-09 10:59:51,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70411736 >2013-12-09 10:59:52,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70411736 >2013-12-09 10:59:57,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 758c96a1 >2013-12-09 10:59:57,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 758c96a1 >2013-12-09 10:59:57,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51a7268b >2013-12-09 10:59:57,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51a7268b >2013-12-09 11:00:02,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56d91ddd >2013-12-09 11:00:03,336 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-80) No up server in cluster >2013-12-09 11:00:03,336 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-80) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:00:03,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74d37f0c >2013-12-09 11:00:03,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 56d91ddd >2013-12-09 11:00:03,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 567bb9a1 >2013-12-09 11:00:03,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterTasksListVDSCommand, return: [], log id: 74d37f0c >2013-12-09 11:00:03,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 567bb9a1 >2013-12-09 11:00:08,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 394a612a >2013-12-09 11:00:09,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 394a612a >2013-12-09 11:00:09,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3323cbeb >2013-12-09 11:00:09,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3323cbeb >2013-12-09 11:00:14,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74f8e23b >2013-12-09 11:00:14,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 74f8e23b >2013-12-09 11:00:14,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c827c25 >2013-12-09 11:00:15,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c827c25 >2013-12-09 11:00:20,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6098cfb6 >2013-12-09 11:00:20,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6098cfb6 >2013-12-09 11:00:20,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 761729e2 >2013-12-09 11:00:20,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 761729e2 >2013-12-09 11:00:25,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37cd75d9 >2013-12-09 11:00:26,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 37cd75d9 >2013-12-09 11:00:26,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 326f1fbb >2013-12-09 11:00:26,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 326f1fbb >2013-12-09 11:00:31,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c69cdc6 >2013-12-09 11:00:32,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3c69cdc6 >2013-12-09 11:00:32,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6859c373 >2013-12-09 11:00:32,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6859c373 >2013-12-09 11:00:37,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f311776 >2013-12-09 11:00:38,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3f311776 >2013-12-09 11:00:38,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62ca8353 >2013-12-09 11:00:38,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62ca8353 >2013-12-09 11:00:43,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5000c56a >2013-12-09 11:00:43,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5000c56a >2013-12-09 11:00:43,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c004418 >2013-12-09 11:00:44,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c004418 >2013-12-09 11:00:49,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1bc081f0 >2013-12-09 11:00:49,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1bc081f0 >2013-12-09 11:00:49,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 429f5d92 >2013-12-09 11:00:49,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 429f5d92 >2013-12-09 11:00:54,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 420279f7 >2013-12-09 11:00:55,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 420279f7 >2013-12-09 11:00:55,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11831d72 >2013-12-09 11:00:55,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11831d72 >2013-12-09 11:01:00,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57ffeb91 >2013-12-09 11:01:01,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 57ffeb91 >2013-12-09 11:01:01,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ce61c3f >2013-12-09 11:01:01,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ce61c3f >2013-12-09 11:01:03,610 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-67) No up server in cluster >2013-12-09 11:01:03,610 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-67) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:01:03,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12185b8f >2013-12-09 11:01:03,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterTasksListVDSCommand, return: [], log id: 12185b8f >2013-12-09 11:01:06,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f4a72c9 >2013-12-09 11:01:06,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: f4a72c9 >2013-12-09 11:01:06,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 15e72ebd >2013-12-09 11:01:07,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15e72ebd >2013-12-09 11:01:12,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 188018ca >2013-12-09 11:01:12,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 188018ca >2013-12-09 11:01:12,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5cbb046 >2013-12-09 11:01:12,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cbb046 >2013-12-09 11:01:17,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13a26828 >2013-12-09 11:01:18,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 13a26828 >2013-12-09 11:01:18,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3715d936 >2013-12-09 11:01:18,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3715d936 >2013-12-09 11:01:23,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d2b45a0 >2013-12-09 11:01:24,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d2b45a0 >2013-12-09 11:01:24,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c83a376 >2013-12-09 11:01:24,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c83a376 >2013-12-09 11:01:29,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 243020f7 >2013-12-09 11:01:30,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 243020f7 >2013-12-09 11:01:30,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a709097 >2013-12-09 11:01:30,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a709097 >2013-12-09 11:01:35,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56550f38 >2013-12-09 11:01:35,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 56550f38 >2013-12-09 11:01:35,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 646427e0 >2013-12-09 11:01:36,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 646427e0 >2013-12-09 11:01:41,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47568b35 >2013-12-09 11:01:41,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 47568b35 >2013-12-09 11:01:41,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62d691a4 >2013-12-09 11:01:41,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62d691a4 >2013-12-09 11:01:46,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 664a5b76 >2013-12-09 11:01:47,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 664a5b76 >2013-12-09 11:01:47,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3eff8e3b >2013-12-09 11:01:47,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3eff8e3b >2013-12-09 11:01:52,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f59643c >2013-12-09 11:01:53,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f59643c >2013-12-09 11:01:53,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 280ede6f >2013-12-09 11:01:53,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 280ede6f >2013-12-09 11:01:58,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d512cf0 >2013-12-09 11:01:59,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d512cf0 >2013-12-09 11:01:59,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 492e4e08 >2013-12-09 11:01:59,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 492e4e08 >2013-12-09 11:02:03,888 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-10) No up server in cluster >2013-12-09 11:02:03,889 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-10) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:02:03,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67f197f8 >2013-12-09 11:02:04,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterTasksListVDSCommand, return: [], log id: 67f197f8 >2013-12-09 11:02:04,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79b2ad96 >2013-12-09 11:02:04,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 79b2ad96 >2013-12-09 11:02:04,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 454c9c85 >2013-12-09 11:02:05,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 454c9c85 >2013-12-09 11:02:10,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63d68661 >2013-12-09 11:02:10,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 63d68661 >2013-12-09 11:02:10,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13088f5b >2013-12-09 11:02:10,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13088f5b >2013-12-09 11:02:15,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b668058 >2013-12-09 11:02:16,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b668058 >2013-12-09 11:02:16,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e6fe9f9 >2013-12-09 11:02:16,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e6fe9f9 >2013-12-09 11:02:21,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 695c7b1b >2013-12-09 11:02:22,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 695c7b1b >2013-12-09 11:02:22,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a27c650 >2013-12-09 11:02:22,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a27c650 >2013-12-09 11:02:27,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bb553f3 >2013-12-09 11:02:27,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4bb553f3 >2013-12-09 11:02:27,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3524799c >2013-12-09 11:02:28,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3524799c >2013-12-09 11:02:33,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5bd7ea28 >2013-12-09 11:02:33,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5bd7ea28 >2013-12-09 11:02:33,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f127973 >2013-12-09 11:02:33,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f127973 >2013-12-09 11:02:38,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b9701fb >2013-12-09 11:02:39,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b9701fb >2013-12-09 11:02:39,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 270361e5 >2013-12-09 11:02:39,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 270361e5 >2013-12-09 11:02:44,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d19e1 >2013-12-09 11:02:45,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d19e1 >2013-12-09 11:02:45,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2160ed71 >2013-12-09 11:02:45,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2160ed71 >2013-12-09 11:02:50,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75a0ad00 >2013-12-09 11:02:51,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 75a0ad00 >2013-12-09 11:02:51,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25fa23a8 >2013-12-09 11:02:51,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25fa23a8 >2013-12-09 11:02:56,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f34b9c1 >2013-12-09 11:02:56,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: f34b9c1 >2013-12-09 11:02:56,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a9d63cf >2013-12-09 11:02:57,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a9d63cf >2013-12-09 11:03:02,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2cfee27b >2013-12-09 11:03:02,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2cfee27b >2013-12-09 11:03:02,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 720ea9a2 >2013-12-09 11:03:02,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 720ea9a2 >2013-12-09 11:03:04,168 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-46) No up server in cluster >2013-12-09 11:03:04,168 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-46) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:03:04,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28ac5797 >2013-12-09 11:03:04,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterTasksListVDSCommand, return: [], log id: 28ac5797 >2013-12-09 11:03:07,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41ab63f0 >2013-12-09 11:03:08,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 41ab63f0 >2013-12-09 11:03:08,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 413e4be6 >2013-12-09 11:03:08,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 413e4be6 >2013-12-09 11:03:13,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b1600e8 >2013-12-09 11:03:14,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b1600e8 >2013-12-09 11:03:14,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: edda1a1 >2013-12-09 11:03:14,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: edda1a1 >2013-12-09 11:03:19,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5af4c9e9 >2013-12-09 11:03:19,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5af4c9e9 >2013-12-09 11:03:19,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c0c7d87 >2013-12-09 11:03:20,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c0c7d87 >2013-12-09 11:03:25,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 408122fb >2013-12-09 11:03:25,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 408122fb >2013-12-09 11:03:25,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2276bf06 >2013-12-09 11:03:25,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2276bf06 >2013-12-09 11:03:30,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20ccd659 >2013-12-09 11:03:31,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 20ccd659 >2013-12-09 11:03:31,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 360b8621 >2013-12-09 11:03:31,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 360b8621 >2013-12-09 11:03:36,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c814444 >2013-12-09 11:03:37,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c814444 >2013-12-09 11:03:37,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f94ea7 >2013-12-09 11:03:37,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f94ea7 >2013-12-09 11:03:42,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7782ce41 >2013-12-09 11:03:42,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7782ce41 >2013-12-09 11:03:42,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45e9ccea >2013-12-09 11:03:43,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45e9ccea >2013-12-09 11:03:48,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36b5f1ac >2013-12-09 11:03:48,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 36b5f1ac >2013-12-09 11:03:48,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45d3a25e >2013-12-09 11:03:49,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45d3a25e >2013-12-09 11:03:54,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74f450bb >2013-12-09 11:03:54,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 74f450bb >2013-12-09 11:03:54,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10dc3443 >2013-12-09 11:03:54,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10dc3443 >2013-12-09 11:03:59,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6565b349 >2013-12-09 11:04:00,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6565b349 >2013-12-09 11:04:00,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a0020fa >2013-12-09 11:04:00,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a0020fa >2013-12-09 11:04:04,451 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-96) No up server in cluster >2013-12-09 11:04:04,451 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-96) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:04:04,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66d63b0b >2013-12-09 11:04:04,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterTasksListVDSCommand, return: [], log id: 66d63b0b >2013-12-09 11:04:05,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1076715e >2013-12-09 11:04:06,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1076715e >2013-12-09 11:04:06,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f00c6fa >2013-12-09 11:04:06,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f00c6fa >2013-12-09 11:04:11,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70014521 >2013-12-09 11:04:11,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 70014521 >2013-12-09 11:04:11,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15cdf666 >2013-12-09 11:04:12,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15cdf666 >2013-12-09 11:04:17,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 214795bf >2013-12-09 11:04:17,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 214795bf >2013-12-09 11:04:17,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77563880 >2013-12-09 11:04:17,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77563880 >2013-12-09 11:04:22,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f6326c6 >2013-12-09 11:04:23,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: f6326c6 >2013-12-09 11:04:23,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fc795fa >2013-12-09 11:04:23,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2fc795fa >2013-12-09 11:04:28,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 624950cc >2013-12-09 11:04:29,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 624950cc >2013-12-09 11:04:29,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 49bf906a >2013-12-09 11:04:29,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49bf906a >2013-12-09 11:04:34,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ae36362 >2013-12-09 11:04:35,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ae36362 >2013-12-09 11:04:35,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16e7c694 >2013-12-09 11:04:35,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16e7c694 >2013-12-09 11:04:40,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 321d61a0 >2013-12-09 11:04:40,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 321d61a0 >2013-12-09 11:04:40,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21b46537 >2013-12-09 11:04:41,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21b46537 >2013-12-09 11:04:46,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f3bb0a0 >2013-12-09 11:04:46,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f3bb0a0 >2013-12-09 11:04:46,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1666104e >2013-12-09 11:04:46,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1666104e >2013-12-09 11:04:51,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48a8e01d >2013-12-09 11:04:52,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 48a8e01d >2013-12-09 11:04:52,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4fc9f7e4 >2013-12-09 11:04:52,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fc9f7e4 >2013-12-09 11:04:57,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41ccc697 >2013-12-09 11:04:58,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 41ccc697 >2013-12-09 11:04:58,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24eec8a0 >2013-12-09 11:04:58,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24eec8a0 >2013-12-09 11:05:03,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64c25363 >2013-12-09 11:05:03,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 64c25363 >2013-12-09 11:05:03,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 265a66ab >2013-12-09 11:05:04,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 265a66ab >2013-12-09 11:05:04,731 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-77) No up server in cluster >2013-12-09 11:05:04,731 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-77) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:05:04,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a46bddc >2013-12-09 11:05:05,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterTasksListVDSCommand, return: [], log id: a46bddc >2013-12-09 11:05:09,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 773ecdbd >2013-12-09 11:05:09,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 773ecdbd >2013-12-09 11:05:09,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70a40598 >2013-12-09 11:05:09,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70a40598 >2013-12-09 11:05:14,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58e42c26 >2013-12-09 11:05:15,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 58e42c26 >2013-12-09 11:05:15,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 378e6801 >2013-12-09 11:05:15,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 378e6801 >2013-12-09 11:05:20,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50cc6665 >2013-12-09 11:05:21,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 50cc6665 >2013-12-09 11:05:21,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ebce328 >2013-12-09 11:05:21,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ebce328 >2013-12-09 11:05:26,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a582ee6 >2013-12-09 11:05:27,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a582ee6 >2013-12-09 11:05:27,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6575c143 >2013-12-09 11:05:27,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6575c143 >2013-12-09 11:05:32,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 409ce57a >2013-12-09 11:05:32,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 409ce57a >2013-12-09 11:05:32,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1cd90b37 >2013-12-09 11:05:33,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1cd90b37 >2013-12-09 11:05:38,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d87134b >2013-12-09 11:05:38,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d87134b >2013-12-09 11:05:38,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 28cb5613 >2013-12-09 11:05:38,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28cb5613 >2013-12-09 11:05:43,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58e0a090 >2013-12-09 11:05:44,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 58e0a090 >2013-12-09 11:05:44,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 244c93cd >2013-12-09 11:05:44,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 244c93cd >2013-12-09 11:05:49,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6726a8ea >2013-12-09 11:05:50,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6726a8ea >2013-12-09 11:05:50,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37bdd8e3 >2013-12-09 11:05:50,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37bdd8e3 >2013-12-09 11:05:55,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b0e6cd3 >2013-12-09 11:05:56,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5b0e6cd3 >2013-12-09 11:05:56,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e521e2e >2013-12-09 11:05:56,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e521e2e >2013-12-09 11:06:01,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f6ddca3 >2013-12-09 11:06:01,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f6ddca3 >2013-12-09 11:06:01,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 327d395 >2013-12-09 11:06:02,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 327d395 >2013-12-09 11:06:05,019 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-22) No up server in cluster >2013-12-09 11:06:05,019 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-22) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:06:05,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47b07895 >2013-12-09 11:06:05,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterTasksListVDSCommand, return: [], log id: 47b07895 >2013-12-09 11:06:07,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4597032f >2013-12-09 11:06:07,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4597032f >2013-12-09 11:06:07,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ea041eb >2013-12-09 11:06:07,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ea041eb >2013-12-09 11:06:12,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6909174e >2013-12-09 11:06:13,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6909174e >2013-12-09 11:06:13,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e3e454e >2013-12-09 11:06:13,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e3e454e >2013-12-09 11:06:18,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 249619c9 >2013-12-09 11:06:19,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 249619c9 >2013-12-09 11:06:19,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f8352f9 >2013-12-09 11:06:19,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f8352f9 >2013-12-09 11:06:24,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 770d4265 >2013-12-09 11:06:24,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 770d4265 >2013-12-09 11:06:24,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f016d18 >2013-12-09 11:06:25,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f016d18 >2013-12-09 11:06:30,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b07cc2d >2013-12-09 11:06:30,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b07cc2d >2013-12-09 11:06:30,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ef92963 >2013-12-09 11:06:31,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ef92963 >2013-12-09 11:06:36,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e53e9cd >2013-12-09 11:06:36,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7e53e9cd >2013-12-09 11:06:36,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b7d184 >2013-12-09 11:06:36,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b7d184 >2013-12-09 11:06:41,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62e8156c >2013-12-09 11:06:42,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 62e8156c >2013-12-09 11:06:42,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6bd6064f >2013-12-09 11:06:42,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6bd6064f >2013-12-09 11:06:47,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a96da8d >2013-12-09 11:06:48,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a96da8d >2013-12-09 11:06:48,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7cca43eb >2013-12-09 11:06:48,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7cca43eb >2013-12-09 11:06:53,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70a4cc3e >2013-12-09 11:06:53,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 70a4cc3e >2013-12-09 11:06:53,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c3f377 >2013-12-09 11:06:54,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c3f377 >2013-12-09 11:06:59,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c1c59af >2013-12-09 11:06:59,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1c1c59af >2013-12-09 11:06:59,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d501648 >2013-12-09 11:06:59,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d501648 >2013-12-09 11:07:04,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a96489f >2013-12-09 11:07:05,291 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-49) No up server in cluster >2013-12-09 11:07:05,291 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-49) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:07:05,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 336f05f >2013-12-09 11:07:05,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: a96489f >2013-12-09 11:07:05,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c24fa8a >2013-12-09 11:07:05,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterTasksListVDSCommand, return: [], log id: 336f05f >2013-12-09 11:07:05,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c24fa8a >2013-12-09 11:07:10,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 131bcfff >2013-12-09 11:07:11,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 131bcfff >2013-12-09 11:07:11,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8d5e359 >2013-12-09 11:07:11,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8d5e359 >2013-12-09 11:07:16,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ac43c96 >2013-12-09 11:07:17,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3ac43c96 >2013-12-09 11:07:17,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7efe4ed8 >2013-12-09 11:07:17,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7efe4ed8 >2013-12-09 11:07:22,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f4d50a2 >2013-12-09 11:07:22,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: f4d50a2 >2013-12-09 11:07:22,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53994543 >2013-12-09 11:07:23,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53994543 >2013-12-09 11:07:28,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 44320458 >2013-12-09 11:07:28,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 44320458 >2013-12-09 11:07:28,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b3a90e2 >2013-12-09 11:07:28,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b3a90e2 >2013-12-09 11:07:33,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1cf9722d >2013-12-09 11:07:34,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1cf9722d >2013-12-09 11:07:34,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16de3e99 >2013-12-09 11:07:34,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16de3e99 >2013-12-09 11:07:39,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5cf37043 >2013-12-09 11:07:40,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5cf37043 >2013-12-09 11:07:40,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 228700f5 >2013-12-09 11:07:40,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 228700f5 >2013-12-09 11:07:45,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28a412cf >2013-12-09 11:07:46,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 28a412cf >2013-12-09 11:07:46,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 557af96c >2013-12-09 11:07:46,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 557af96c >2013-12-09 11:07:51,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f5a0a95 >2013-12-09 11:07:51,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5f5a0a95 >2013-12-09 11:07:51,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d78e924 >2013-12-09 11:07:52,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d78e924 >2013-12-09 11:07:57,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48fbf084 >2013-12-09 11:07:57,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 48fbf084 >2013-12-09 11:07:57,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1851268f >2013-12-09 11:07:58,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1851268f >2013-12-09 11:08:03,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72614d3c >2013-12-09 11:08:03,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 72614d3c >2013-12-09 11:08:03,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35d2315d >2013-12-09 11:08:03,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35d2315d >2013-12-09 11:08:05,574 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-36) No up server in cluster >2013-12-09 11:08:05,574 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-36) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:08:05,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c1d6133 >2013-12-09 11:08:05,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7c1d6133 >2013-12-09 11:08:08,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33693271 >2013-12-09 11:08:09,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 33693271 >2013-12-09 11:08:09,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ad90773 >2013-12-09 11:08:09,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ad90773 >2013-12-09 11:08:14,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3723f31b >2013-12-09 11:08:15,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3723f31b >2013-12-09 11:08:15,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23729f0c >2013-12-09 11:08:15,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23729f0c >2013-12-09 11:08:20,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40844c9a >2013-12-09 11:08:20,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 40844c9a >2013-12-09 11:08:20,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5df31d36 >2013-12-09 11:08:21,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5df31d36 >2013-12-09 11:08:26,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c696ef8 >2013-12-09 11:08:26,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4c696ef8 >2013-12-09 11:08:26,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7038ea93 >2013-12-09 11:08:26,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7038ea93 >2013-12-09 11:08:31,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37c56c3f >2013-12-09 11:08:32,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 37c56c3f >2013-12-09 11:08:32,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 318f8c68 >2013-12-09 11:08:32,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 318f8c68 >2013-12-09 11:08:37,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 432ee955 >2013-12-09 11:08:38,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 432ee955 >2013-12-09 11:08:38,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d0135db >2013-12-09 11:08:38,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d0135db >2013-12-09 11:08:43,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57016d45 >2013-12-09 11:08:44,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 57016d45 >2013-12-09 11:08:44,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15a9c218 >2013-12-09 11:08:44,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15a9c218 >2013-12-09 11:08:49,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d2be459 >2013-12-09 11:08:49,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d2be459 >2013-12-09 11:08:49,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2dd6b755 >2013-12-09 11:08:50,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2dd6b755 >2013-12-09 11:08:55,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ebce1f0 >2013-12-09 11:08:55,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7ebce1f0 >2013-12-09 11:08:55,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 206b23b3 >2013-12-09 11:08:55,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 206b23b3 >2013-12-09 11:09:00,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f67711c >2013-12-09 11:09:01,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f67711c >2013-12-09 11:09:01,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 60e6e165 >2013-12-09 11:09:01,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60e6e165 >2013-12-09 11:09:05,861 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-31) No up server in cluster >2013-12-09 11:09:05,861 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-31) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:09:05,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c91cf6f >2013-12-09 11:09:06,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2c91cf6f >2013-12-09 11:09:06,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 351e834f >2013-12-09 11:09:07,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 351e834f >2013-12-09 11:09:07,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d7d29b7 >2013-12-09 11:09:07,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d7d29b7 >2013-12-09 11:09:12,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6dc6c91b >2013-12-09 11:09:12,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6dc6c91b >2013-12-09 11:09:12,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68d66278 >2013-12-09 11:09:13,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68d66278 >2013-12-09 11:09:18,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61792fa0 >2013-12-09 11:09:18,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 61792fa0 >2013-12-09 11:09:18,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73cd63f2 >2013-12-09 11:09:18,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73cd63f2 >2013-12-09 11:09:23,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: bd1a2cd >2013-12-09 11:09:24,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: bd1a2cd >2013-12-09 11:09:24,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4462a4f4 >2013-12-09 11:09:24,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4462a4f4 >2013-12-09 11:09:29,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6100892f >2013-12-09 11:09:30,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6100892f >2013-12-09 11:09:30,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4514ca9f >2013-12-09 11:09:30,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4514ca9f >2013-12-09 11:09:35,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26d94e9a >2013-12-09 11:09:36,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 26d94e9a >2013-12-09 11:09:36,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 298edb20 >2013-12-09 11:09:36,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 298edb20 >2013-12-09 11:09:41,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 668688b6 >2013-12-09 11:09:41,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 668688b6 >2013-12-09 11:09:41,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 322dda1 >2013-12-09 11:09:42,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 322dda1 >2013-12-09 11:09:47,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35f1695 >2013-12-09 11:09:47,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 35f1695 >2013-12-09 11:09:47,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d8ed7c1 >2013-12-09 11:09:47,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d8ed7c1 >2013-12-09 11:09:52,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 784a2a3b >2013-12-09 11:09:53,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 784a2a3b >2013-12-09 11:09:53,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 696906f7 >2013-12-09 11:09:53,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 696906f7 >2013-12-09 11:09:58,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3782fb66 >2013-12-09 11:09:59,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3782fb66 >2013-12-09 11:09:59,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ccb5f15 >2013-12-09 11:09:59,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ccb5f15 >2013-12-09 11:10:04,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6cad5839 >2013-12-09 11:10:04,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6cad5839 >2013-12-09 11:10:04,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e9cd6ea >2013-12-09 11:10:05,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e9cd6ea >2013-12-09 11:10:06,149 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-4) No up server in cluster >2013-12-09 11:10:06,149 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-4) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:10:06,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 142710c0 >2013-12-09 11:10:06,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterTasksListVDSCommand, return: [], log id: 142710c0 >2013-12-09 11:10:10,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45fa3e3b >2013-12-09 11:10:10,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 45fa3e3b >2013-12-09 11:10:10,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20cf4bc2 >2013-12-09 11:10:10,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20cf4bc2 >2013-12-09 11:10:16,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59d025f7 >2013-12-09 11:10:16,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59d025f7 >2013-12-09 11:10:16,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b61e04c >2013-12-09 11:10:16,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b61e04c >2013-12-09 11:10:21,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27be9616 >2013-12-09 11:10:22,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 27be9616 >2013-12-09 11:10:22,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73e999ac >2013-12-09 11:10:22,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73e999ac >2013-12-09 11:10:27,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2652a3c7 >2013-12-09 11:10:28,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2652a3c7 >2013-12-09 11:10:28,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61b84e49 >2013-12-09 11:10:28,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61b84e49 >2013-12-09 11:10:33,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e5027ee >2013-12-09 11:10:33,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: e5027ee >2013-12-09 11:10:33,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 529496e3 >2013-12-09 11:10:34,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 529496e3 >2013-12-09 11:10:39,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c9d592f >2013-12-09 11:10:39,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c9d592f >2013-12-09 11:10:39,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5880327 >2013-12-09 11:10:39,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5880327 >2013-12-09 11:10:44,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 15c0a632 >2013-12-09 11:10:45,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 15c0a632 >2013-12-09 11:10:45,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1747c219 >2013-12-09 11:10:45,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1747c219 >2013-12-09 11:10:50,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67c619cc >2013-12-09 11:10:51,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 67c619cc >2013-12-09 11:10:51,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: aac17a6 >2013-12-09 11:10:51,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: aac17a6 >2013-12-09 11:10:56,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78d3d7d1 >2013-12-09 11:10:56,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 78d3d7d1 >2013-12-09 11:10:56,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53d023f4 >2013-12-09 11:10:57,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53d023f4 >2013-12-09 11:11:02,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 279571a >2013-12-09 11:11:02,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 279571a >2013-12-09 11:11:02,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a96b272 >2013-12-09 11:11:03,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a96b272 >2013-12-09 11:11:06,428 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-53) No up server in cluster >2013-12-09 11:11:06,429 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-53) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:11:06,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ea04f36 >2013-12-09 11:11:06,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterTasksListVDSCommand, return: [], log id: ea04f36 >2013-12-09 11:11:08,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42c3bc6f >2013-12-09 11:11:08,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42c3bc6f >2013-12-09 11:11:08,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3254ef9a >2013-12-09 11:11:08,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3254ef9a >2013-12-09 11:11:13,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2aaa1906 >2013-12-09 11:11:14,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2aaa1906 >2013-12-09 11:11:14,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 169fdc6 >2013-12-09 11:11:14,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 169fdc6 >2013-12-09 11:11:19,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e0d9747 >2013-12-09 11:11:20,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7e0d9747 >2013-12-09 11:11:20,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c1c4a6 >2013-12-09 11:11:20,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c1c4a6 >2013-12-09 11:11:25,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33f87004 >2013-12-09 11:11:25,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 33f87004 >2013-12-09 11:11:25,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 686110fc >2013-12-09 11:11:26,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 686110fc >2013-12-09 11:11:31,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a764854 >2013-12-09 11:11:31,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4a764854 >2013-12-09 11:11:31,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c35400e >2013-12-09 11:11:31,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c35400e >2013-12-09 11:11:36,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7692984f >2013-12-09 11:11:37,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7692984f >2013-12-09 11:11:37,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ee9452c >2013-12-09 11:11:37,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ee9452c >2013-12-09 11:11:42,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 547807a6 >2013-12-09 11:11:43,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 547807a6 >2013-12-09 11:11:43,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2784b8ab >2013-12-09 11:11:43,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2784b8ab >2013-12-09 11:11:48,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2bff51d7 >2013-12-09 11:11:49,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2bff51d7 >2013-12-09 11:11:49,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40eeb85c >2013-12-09 11:11:49,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40eeb85c >2013-12-09 11:11:54,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 418b7ae2 >2013-12-09 11:11:54,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 418b7ae2 >2013-12-09 11:11:54,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ea29340 >2013-12-09 11:11:55,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ea29340 >2013-12-09 11:12:00,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18b55a5e >2013-12-09 11:12:00,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 18b55a5e >2013-12-09 11:12:00,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d715251 >2013-12-09 11:12:00,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d715251 >2013-12-09 11:12:05,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75636b57 >2013-12-09 11:12:06,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 75636b57 >2013-12-09 11:12:06,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: fcc8d3d >2013-12-09 11:12:06,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: fcc8d3d >2013-12-09 11:12:06,706 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-79) No up server in cluster >2013-12-09 11:12:06,706 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-79) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:12:06,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 966d206 >2013-12-09 11:12:06,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterTasksListVDSCommand, return: [], log id: 966d206 >2013-12-09 11:12:11,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2428cc75 >2013-12-09 11:12:12,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2428cc75 >2013-12-09 11:12:12,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33796c3 >2013-12-09 11:12:12,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33796c3 >2013-12-09 11:12:17,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54ff7e3c >2013-12-09 11:12:17,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 54ff7e3c >2013-12-09 11:12:17,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20b4599d >2013-12-09 11:12:18,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20b4599d >2013-12-09 11:12:23,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 335e8bc6 >2013-12-09 11:12:23,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 335e8bc6 >2013-12-09 11:12:23,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 327adb5d >2013-12-09 11:12:23,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 327adb5d >2013-12-09 11:12:28,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 176b1ee7 >2013-12-09 11:12:29,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 176b1ee7 >2013-12-09 11:12:29,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a93803e >2013-12-09 11:12:29,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a93803e >2013-12-09 11:12:34,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59f372bf >2013-12-09 11:12:35,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59f372bf >2013-12-09 11:12:35,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b741711 >2013-12-09 11:12:35,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b741711 >2013-12-09 11:12:40,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48c49a68 >2013-12-09 11:12:41,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 48c49a68 >2013-12-09 11:12:41,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c30172c >2013-12-09 11:12:41,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c30172c >2013-12-09 11:12:46,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bf82409 >2013-12-09 11:12:46,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4bf82409 >2013-12-09 11:12:46,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e5acffa >2013-12-09 11:12:47,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e5acffa >2013-12-09 11:12:52,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19e5998a >2013-12-09 11:12:52,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 19e5998a >2013-12-09 11:12:52,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b11fa4b >2013-12-09 11:12:52,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b11fa4b >2013-12-09 11:12:57,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c2ca1c9 >2013-12-09 11:12:58,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4c2ca1c9 >2013-12-09 11:12:58,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 434dbef4 >2013-12-09 11:12:58,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 434dbef4 >2013-12-09 11:13:03,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5717d08e >2013-12-09 11:13:04,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5717d08e >2013-12-09 11:13:04,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a96ef59 >2013-12-09 11:13:04,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a96ef59 >2013-12-09 11:13:06,996 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-62) No up server in cluster >2013-12-09 11:13:06,996 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-62) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:13:07,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: dcbcabe >2013-12-09 11:13:07,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterTasksListVDSCommand, return: [], log id: dcbcabe >2013-12-09 11:13:09,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f7eb7f4 >2013-12-09 11:13:09,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f7eb7f4 >2013-12-09 11:13:09,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 729ad070 >2013-12-09 11:13:10,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 729ad070 >2013-12-09 11:13:15,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 548da0a8 >2013-12-09 11:13:15,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 548da0a8 >2013-12-09 11:13:15,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 660a7012 >2013-12-09 11:13:15,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 660a7012 >2013-12-09 11:13:21,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4dd20abb >2013-12-09 11:13:21,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4dd20abb >2013-12-09 11:13:21,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45e123f4 >2013-12-09 11:13:21,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45e123f4 >2013-12-09 11:13:26,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41412ac0 >2013-12-09 11:13:27,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 41412ac0 >2013-12-09 11:13:27,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5430f2f >2013-12-09 11:13:27,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5430f2f >2013-12-09 11:13:32,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6abae819 >2013-12-09 11:13:33,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6abae819 >2013-12-09 11:13:33,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 389eba5c >2013-12-09 11:13:33,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 389eba5c >2013-12-09 11:13:38,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4064809e >2013-12-09 11:13:38,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4064809e >2013-12-09 11:13:38,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a51a08 >2013-12-09 11:13:39,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a51a08 >2013-12-09 11:13:44,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 421b984f >2013-12-09 11:13:44,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 421b984f >2013-12-09 11:13:44,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 596ec4f6 >2013-12-09 11:13:44,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 596ec4f6 >2013-12-09 11:13:49,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e4f58f >2013-12-09 11:13:50,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3e4f58f >2013-12-09 11:13:50,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: bf3f1ca >2013-12-09 11:13:50,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: bf3f1ca >2013-12-09 11:13:55,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16fbfca2 >2013-12-09 11:13:56,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 16fbfca2 >2013-12-09 11:13:56,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15013d3a >2013-12-09 11:13:56,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15013d3a >2013-12-09 11:14:01,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c761fd9 >2013-12-09 11:14:01,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c761fd9 >2013-12-09 11:14:01,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71d976b0 >2013-12-09 11:14:02,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71d976b0 >2013-12-09 11:14:07,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 347824ab >2013-12-09 11:14:07,274 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-15) No up server in cluster >2013-12-09 11:14:07,274 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-15) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:14:07,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7000b8c6 >2013-12-09 11:14:07,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7000b8c6 >2013-12-09 11:14:07,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 347824ab >2013-12-09 11:14:07,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32048c5c >2013-12-09 11:14:07,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32048c5c >2013-12-09 11:14:13,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6520bee6 >2013-12-09 11:14:13,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6520bee6 >2013-12-09 11:14:13,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b30a03 >2013-12-09 11:14:13,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b30a03 >2013-12-09 11:14:18,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e2064f4 >2013-12-09 11:14:19,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e2064f4 >2013-12-09 11:14:19,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45cae5c3 >2013-12-09 11:14:19,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45cae5c3 >2013-12-09 11:14:24,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 679f79ec >2013-12-09 11:14:25,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 679f79ec >2013-12-09 11:14:25,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58ea6725 >2013-12-09 11:14:25,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58ea6725 >2013-12-09 11:14:30,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74fd3c06 >2013-12-09 11:14:30,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 74fd3c06 >2013-12-09 11:14:30,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 741a05ee >2013-12-09 11:14:31,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 741a05ee >2013-12-09 11:14:36,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 387335e6 >2013-12-09 11:14:36,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 387335e6 >2013-12-09 11:14:36,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d9a3fcc >2013-12-09 11:14:36,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d9a3fcc >2013-12-09 11:14:41,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27df87ec >2013-12-09 11:14:42,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 27df87ec >2013-12-09 11:14:42,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68d07a16 >2013-12-09 11:14:42,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68d07a16 >2013-12-09 11:14:47,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 366abcd7 >2013-12-09 11:14:48,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 366abcd7 >2013-12-09 11:14:48,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10f95966 >2013-12-09 11:14:48,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10f95966 >2013-12-09 11:14:53,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 323b72e7 >2013-12-09 11:14:54,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 323b72e7 >2013-12-09 11:14:54,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 359cce29 >2013-12-09 11:14:54,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 359cce29 >2013-12-09 11:14:59,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6cc555ea >2013-12-09 11:14:59,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6cc555ea >2013-12-09 11:14:59,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 24555c0 >2013-12-09 11:15:00,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24555c0 >2013-12-09 11:15:05,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16599ccb >2013-12-09 11:15:05,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 16599ccb >2013-12-09 11:15:05,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4cbc57b5 >2013-12-09 11:15:05,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4cbc57b5 >2013-12-09 11:15:07,514 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-78) No up server in cluster >2013-12-09 11:15:07,515 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-78) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:15:07,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2001f8f2 >2013-12-09 11:15:07,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2001f8f2 >2013-12-09 11:15:10,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 24f5910c >2013-12-09 11:15:11,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 24f5910c >2013-12-09 11:15:11,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e01a31 >2013-12-09 11:15:11,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e01a31 >2013-12-09 11:15:16,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f037db8 >2013-12-09 11:15:17,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f037db8 >2013-12-09 11:15:17,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f318f4d >2013-12-09 11:15:17,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f318f4d >2013-12-09 11:15:22,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4db377a4 >2013-12-09 11:15:22,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4db377a4 >2013-12-09 11:15:22,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5689f61c >2013-12-09 11:15:23,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5689f61c >2013-12-09 11:15:28,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7991d74e >2013-12-09 11:15:28,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7991d74e >2013-12-09 11:15:28,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79d45792 >2013-12-09 11:15:28,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79d45792 >2013-12-09 11:15:34,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c9085dc >2013-12-09 11:15:34,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5c9085dc >2013-12-09 11:15:34,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e49a995 >2013-12-09 11:15:34,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e49a995 >2013-12-09 11:15:39,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55e54534 >2013-12-09 11:15:40,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 55e54534 >2013-12-09 11:15:40,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ca3d79e >2013-12-09 11:15:40,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ca3d79e >2013-12-09 11:15:45,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e1c5170 >2013-12-09 11:15:46,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2e1c5170 >2013-12-09 11:15:46,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36a3a83b >2013-12-09 11:15:46,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36a3a83b >2013-12-09 11:15:51,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a3640ae >2013-12-09 11:15:51,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6a3640ae >2013-12-09 11:15:51,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29cdf0c7 >2013-12-09 11:15:52,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29cdf0c7 >2013-12-09 11:15:57,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c10dde3 >2013-12-09 11:15:57,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7c10dde3 >2013-12-09 11:15:57,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32ecf158 >2013-12-09 11:15:57,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32ecf158 >2013-12-09 11:16:02,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70c47f9b >2013-12-09 11:16:03,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 70c47f9b >2013-12-09 11:16:03,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32cbfbcf >2013-12-09 11:16:03,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32cbfbcf >2013-12-09 11:16:07,798 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-48) No up server in cluster >2013-12-09 11:16:07,798 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-48) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:16:07,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58d27e61 >2013-12-09 11:16:08,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterTasksListVDSCommand, return: [], log id: 58d27e61 >2013-12-09 11:16:08,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 14a0a1e7 >2013-12-09 11:16:09,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 14a0a1e7 >2013-12-09 11:16:09,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6cdcf06e >2013-12-09 11:16:09,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6cdcf06e >2013-12-09 11:16:14,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41ca4e5c >2013-12-09 11:16:14,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 41ca4e5c >2013-12-09 11:16:14,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e68af84 >2013-12-09 11:16:15,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e68af84 >2013-12-09 11:16:20,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f694f7c >2013-12-09 11:16:20,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f694f7c >2013-12-09 11:16:20,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 371a0a9d >2013-12-09 11:16:20,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 371a0a9d >2013-12-09 11:16:26,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19a3abab >2013-12-09 11:16:26,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19a3abab >2013-12-09 11:16:26,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 536c5298 >2013-12-09 11:16:26,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 536c5298 >2013-12-09 11:16:31,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66f62d5d >2013-12-09 11:16:32,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 66f62d5d >2013-12-09 11:16:32,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12fc120f >2013-12-09 11:16:32,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12fc120f >2013-12-09 11:16:37,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 125b04a5 >2013-12-09 11:16:38,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 125b04a5 >2013-12-09 11:16:38,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f4f1d2e >2013-12-09 11:16:38,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f4f1d2e >2013-12-09 11:16:43,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9af5aa0 >2013-12-09 11:16:43,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 9af5aa0 >2013-12-09 11:16:43,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1eb63160 >2013-12-09 11:16:44,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1eb63160 >2013-12-09 11:16:49,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17d144c0 >2013-12-09 11:16:49,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 17d144c0 >2013-12-09 11:16:49,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5047c097 >2013-12-09 11:16:49,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5047c097 >2013-12-09 11:16:54,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18d196f3 >2013-12-09 11:16:55,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 18d196f3 >2013-12-09 11:16:55,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d44dacb >2013-12-09 11:16:55,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d44dacb >2013-12-09 11:17:00,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 471e11ad >2013-12-09 11:17:01,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 471e11ad >2013-12-09 11:17:01,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c9f1a62 >2013-12-09 11:17:01,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c9f1a62 >2013-12-09 11:17:06,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6cc0485a >2013-12-09 11:17:06,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6cc0485a >2013-12-09 11:17:06,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1daed8f2 >2013-12-09 11:17:07,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1daed8f2 >2013-12-09 11:17:08,078 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-19) No up server in cluster >2013-12-09 11:17:08,078 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-19) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:17:08,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b9d4585 >2013-12-09 11:17:08,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6b9d4585 >2013-12-09 11:17:12,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 189a1e4b >2013-12-09 11:17:12,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 189a1e4b >2013-12-09 11:17:12,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d05b3d8 >2013-12-09 11:17:13,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d05b3d8 >2013-12-09 11:17:18,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5142bbbc >2013-12-09 11:17:18,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5142bbbc >2013-12-09 11:17:18,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31fb053 >2013-12-09 11:17:18,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31fb053 >2013-12-09 11:17:23,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b0fa189 >2013-12-09 11:17:24,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b0fa189 >2013-12-09 11:17:24,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d337c63 >2013-12-09 11:17:24,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d337c63 >2013-12-09 11:17:29,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36f754df >2013-12-09 11:17:30,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 36f754df >2013-12-09 11:17:30,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20f462b8 >2013-12-09 11:17:30,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20f462b8 >2013-12-09 11:17:35,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 94f90d3 >2013-12-09 11:17:35,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 94f90d3 >2013-12-09 11:17:35,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3215b27b >2013-12-09 11:17:36,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3215b27b >2013-12-09 11:17:41,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 755c9888 >2013-12-09 11:17:41,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 755c9888 >2013-12-09 11:17:41,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c0e794c >2013-12-09 11:17:41,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c0e794c >2013-12-09 11:17:46,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12eb61bc >2013-12-09 11:17:47,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 12eb61bc >2013-12-09 11:17:47,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 789f66a5 >2013-12-09 11:17:47,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 789f66a5 >2013-12-09 11:17:52,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d7afe78 >2013-12-09 11:17:53,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d7afe78 >2013-12-09 11:17:53,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f440adc >2013-12-09 11:17:53,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f440adc >2013-12-09 11:17:58,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d6b0b35 >2013-12-09 11:17:58,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d6b0b35 >2013-12-09 11:17:58,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71d2697f >2013-12-09 11:17:59,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71d2697f >2013-12-09 11:18:04,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51fbc3ad >2013-12-09 11:18:04,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 51fbc3ad >2013-12-09 11:18:04,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56a4775 >2013-12-09 11:18:05,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56a4775 >2013-12-09 11:18:08,358 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-25) No up server in cluster >2013-12-09 11:18:08,358 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-25) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:18:08,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38fb0105 >2013-12-09 11:18:08,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterTasksListVDSCommand, return: [], log id: 38fb0105 >2013-12-09 11:18:10,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50b690ff >2013-12-09 11:18:10,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 50b690ff >2013-12-09 11:18:10,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58fac020 >2013-12-09 11:18:10,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58fac020 >2013-12-09 11:18:15,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79fc2451 >2013-12-09 11:18:16,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 79fc2451 >2013-12-09 11:18:16,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e50e948 >2013-12-09 11:18:16,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e50e948 >2013-12-09 11:18:21,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b57ec1a >2013-12-09 11:18:22,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b57ec1a >2013-12-09 11:18:22,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21903e99 >2013-12-09 11:18:22,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21903e99 >2013-12-09 11:18:27,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5eb3dd59 >2013-12-09 11:18:27,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5eb3dd59 >2013-12-09 11:18:27,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50178930 >2013-12-09 11:18:28,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50178930 >2013-12-09 11:18:33,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3135f0c0 >2013-12-09 11:18:33,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3135f0c0 >2013-12-09 11:18:33,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4dfb9e56 >2013-12-09 11:18:33,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4dfb9e56 >2013-12-09 11:18:38,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 558519fa >2013-12-09 11:18:39,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 558519fa >2013-12-09 11:18:39,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b803154 >2013-12-09 11:18:39,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b803154 >2013-12-09 11:18:44,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d3e5536 >2013-12-09 11:18:45,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d3e5536 >2013-12-09 11:18:45,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4abce889 >2013-12-09 11:18:45,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4abce889 >2013-12-09 11:18:50,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5fc0f836 >2013-12-09 11:18:50,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5fc0f836 >2013-12-09 11:18:51,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 462af729 >2013-12-09 11:18:51,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 462af729 >2013-12-09 11:18:56,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f6f590c >2013-12-09 11:18:56,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f6f590c >2013-12-09 11:18:56,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 49ba47ce >2013-12-09 11:18:57,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49ba47ce >2013-12-09 11:19:02,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b0d2b46 >2013-12-09 11:19:02,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b0d2b46 >2013-12-09 11:19:02,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50a185ae >2013-12-09 11:19:02,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50a185ae >2013-12-09 11:19:07,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7bb4ca64 >2013-12-09 11:19:08,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7bb4ca64 >2013-12-09 11:19:08,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 203b0809 >2013-12-09 11:19:08,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 203b0809 >2013-12-09 11:19:08,646 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-75) No up server in cluster >2013-12-09 11:19:08,646 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-75) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:19:08,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a60bc29 >2013-12-09 11:19:08,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7a60bc29 >2013-12-09 11:19:13,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b5779aa >2013-12-09 11:19:14,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: b5779aa >2013-12-09 11:19:14,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48b81bb3 >2013-12-09 11:19:14,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48b81bb3 >2013-12-09 11:19:19,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6124074 >2013-12-09 11:19:19,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6124074 >2013-12-09 11:19:19,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 587bf266 >2013-12-09 11:19:20,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 587bf266 >2013-12-09 11:19:25,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a04076e >2013-12-09 11:19:25,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a04076e >2013-12-09 11:19:25,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1dfb44db >2013-12-09 11:19:25,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1dfb44db >2013-12-09 11:19:30,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75aeefbd >2013-12-09 11:19:31,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 75aeefbd >2013-12-09 11:19:31,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: acd8131 >2013-12-09 11:19:31,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: acd8131 >2013-12-09 11:19:36,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3991f400 >2013-12-09 11:19:37,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3991f400 >2013-12-09 11:19:37,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39a5513f >2013-12-09 11:19:37,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39a5513f >2013-12-09 11:19:42,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b6bf7aa >2013-12-09 11:19:43,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5b6bf7aa >2013-12-09 11:19:43,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33b3abca >2013-12-09 11:19:43,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33b3abca >2013-12-09 11:19:48,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e741b55 >2013-12-09 11:19:48,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e741b55 >2013-12-09 11:19:48,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 171685ea >2013-12-09 11:19:49,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 171685ea >2013-12-09 11:19:54,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42f62af8 >2013-12-09 11:19:54,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42f62af8 >2013-12-09 11:19:54,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71617bc4 >2013-12-09 11:19:54,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71617bc4 >2013-12-09 11:19:59,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72edab28 >2013-12-09 11:20:00,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 72edab28 >2013-12-09 11:20:00,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3398b9f5 >2013-12-09 11:20:00,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3398b9f5 >2013-12-09 11:20:05,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f2c201c >2013-12-09 11:20:06,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f2c201c >2013-12-09 11:20:06,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4fc25ecc >2013-12-09 11:20:06,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fc25ecc >2013-12-09 11:20:08,927 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-89) No up server in cluster >2013-12-09 11:20:08,927 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-89) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:20:08,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6cbfcaad >2013-12-09 11:20:09,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6cbfcaad >2013-12-09 11:20:11,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d312fb9 >2013-12-09 11:20:11,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d312fb9 >2013-12-09 11:20:11,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 640478d1 >2013-12-09 11:20:12,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 640478d1 >2013-12-09 11:20:17,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55ec3acf >2013-12-09 11:20:17,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 55ec3acf >2013-12-09 11:20:17,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ee4a47e >2013-12-09 11:20:17,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ee4a47e >2013-12-09 11:20:22,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 125b1cd8 >2013-12-09 11:20:23,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 125b1cd8 >2013-12-09 11:20:23,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65634723 >2013-12-09 11:20:23,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65634723 >2013-12-09 11:20:28,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: dee55a7 >2013-12-09 11:20:29,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: dee55a7 >2013-12-09 11:20:29,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 239ef44d >2013-12-09 11:20:29,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 239ef44d >2013-12-09 11:20:34,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 294aeaee >2013-12-09 11:20:34,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 294aeaee >2013-12-09 11:20:34,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ac0ef25 >2013-12-09 11:20:35,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ac0ef25 >2013-12-09 11:20:40,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74ad13e3 >2013-12-09 11:20:40,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 74ad13e3 >2013-12-09 11:20:40,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12780145 >2013-12-09 11:20:41,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12780145 >2013-12-09 11:20:46,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29765ab >2013-12-09 11:20:46,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 29765ab >2013-12-09 11:20:46,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46185304 >2013-12-09 11:20:46,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46185304 >2013-12-09 11:20:51,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26ae65a2 >2013-12-09 11:20:52,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 26ae65a2 >2013-12-09 11:20:52,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31dc9104 >2013-12-09 11:20:52,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31dc9104 >2013-12-09 11:20:57,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a805371 >2013-12-09 11:20:58,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2a805371 >2013-12-09 11:20:58,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d04a068 >2013-12-09 11:20:58,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d04a068 >2013-12-09 11:21:03,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d35fbb4 >2013-12-09 11:21:03,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d35fbb4 >2013-12-09 11:21:03,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65b2245e >2013-12-09 11:21:04,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65b2245e >2013-12-09 11:21:09,200 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-96) No up server in cluster >2013-12-09 11:21:09,200 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-96) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:21:09,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a763188 >2013-12-09 11:21:09,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ae061e >2013-12-09 11:21:09,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5a763188 >2013-12-09 11:21:09,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5ae061e >2013-12-09 11:21:09,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 399c56af >2013-12-09 11:21:09,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 399c56af >2013-12-09 11:21:14,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34529ea3 >2013-12-09 11:21:15,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 34529ea3 >2013-12-09 11:21:15,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1da81e20 >2013-12-09 11:21:15,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1da81e20 >2013-12-09 11:21:20,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d4c270c >2013-12-09 11:21:21,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: d4c270c >2013-12-09 11:21:21,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54a1c4ed >2013-12-09 11:21:21,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54a1c4ed >2013-12-09 11:21:26,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b4d3698 >2013-12-09 11:21:27,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b4d3698 >2013-12-09 11:21:27,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63e19165 >2013-12-09 11:21:27,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63e19165 >2013-12-09 11:21:32,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 276897a4 >2013-12-09 11:21:32,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 276897a4 >2013-12-09 11:21:32,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 188bfbce >2013-12-09 11:21:33,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 188bfbce >2013-12-09 11:21:38,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3891cfd6 >2013-12-09 11:21:38,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3891cfd6 >2013-12-09 11:21:38,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f394929 >2013-12-09 11:21:38,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f394929 >2013-12-09 11:21:43,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 60fb82f4 >2013-12-09 11:21:44,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 60fb82f4 >2013-12-09 11:21:44,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23fb92ad >2013-12-09 11:21:44,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23fb92ad >2013-12-09 11:21:49,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1188674a >2013-12-09 11:21:50,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1188674a >2013-12-09 11:21:50,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 96f80a4 >2013-12-09 11:21:50,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 96f80a4 >2013-12-09 11:21:55,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4161cd2e >2013-12-09 11:21:55,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4161cd2e >2013-12-09 11:21:55,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6df3f99a >2013-12-09 11:21:56,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6df3f99a >2013-12-09 11:22:01,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77176dc1 >2013-12-09 11:22:01,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 77176dc1 >2013-12-09 11:22:01,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25b7691c >2013-12-09 11:22:01,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25b7691c >2013-12-09 11:22:06,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37a4b4f1 >2013-12-09 11:22:07,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 37a4b4f1 >2013-12-09 11:22:07,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4906e3f2 >2013-12-09 11:22:07,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4906e3f2 >2013-12-09 11:22:09,468 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-86) No up server in cluster >2013-12-09 11:22:09,468 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-86) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:22:09,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1fffa02b >2013-12-09 11:22:09,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1fffa02b >2013-12-09 11:22:12,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 509a4299 >2013-12-09 11:22:13,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 509a4299 >2013-12-09 11:22:13,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3bcb1e4a >2013-12-09 11:22:13,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3bcb1e4a >2013-12-09 11:22:18,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d10eaaf >2013-12-09 11:22:18,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4d10eaaf >2013-12-09 11:22:18,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ae5cd15 >2013-12-09 11:22:19,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ae5cd15 >2013-12-09 11:22:24,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 530d1b6b >2013-12-09 11:22:24,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 530d1b6b >2013-12-09 11:22:24,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ffac2c7 >2013-12-09 11:22:24,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ffac2c7 >2013-12-09 11:22:30,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6fe2e952 >2013-12-09 11:22:30,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6fe2e952 >2013-12-09 11:22:30,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6fd54dd7 >2013-12-09 11:22:30,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6fd54dd7 >2013-12-09 11:22:35,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5288c84a >2013-12-09 11:22:36,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5288c84a >2013-12-09 11:22:36,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 147a1087 >2013-12-09 11:22:36,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 147a1087 >2013-12-09 11:22:41,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5893d4be >2013-12-09 11:22:42,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5893d4be >2013-12-09 11:22:42,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 624ce551 >2013-12-09 11:22:42,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 624ce551 >2013-12-09 11:22:47,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e2df022 >2013-12-09 11:22:47,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1e2df022 >2013-12-09 11:22:47,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b8f2359 >2013-12-09 11:22:48,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b8f2359 >2013-12-09 11:22:53,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 347b76c >2013-12-09 11:22:53,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 347b76c >2013-12-09 11:22:53,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53b0bc01 >2013-12-09 11:22:53,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53b0bc01 >2013-12-09 11:22:58,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26f4d488 >2013-12-09 11:22:59,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 26f4d488 >2013-12-09 11:22:59,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e7f957e >2013-12-09 11:22:59,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e7f957e >2013-12-09 11:23:04,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13c07846 >2013-12-09 11:23:05,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 13c07846 >2013-12-09 11:23:05,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c138423 >2013-12-09 11:23:05,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c138423 >2013-12-09 11:23:09,746 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-47) No up server in cluster >2013-12-09 11:23:09,746 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-47) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:23:09,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a57a35a >2013-12-09 11:23:10,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7a57a35a >2013-12-09 11:23:10,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4bd77003 >2013-12-09 11:23:10,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4bd77003 >2013-12-09 11:23:10,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4dce05eb >2013-12-09 11:23:11,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4dce05eb >2013-12-09 11:23:16,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38ebe3cd >2013-12-09 11:23:16,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 38ebe3cd >2013-12-09 11:23:16,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e0af697 >2013-12-09 11:23:16,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e0af697 >2013-12-09 11:23:21,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 260c8cf4 >2013-12-09 11:23:22,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 260c8cf4 >2013-12-09 11:23:22,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 443b3ecc >2013-12-09 11:23:22,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 443b3ecc >2013-12-09 11:23:27,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f3b4c56 >2013-12-09 11:23:28,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5f3b4c56 >2013-12-09 11:23:28,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c227603 >2013-12-09 11:23:28,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c227603 >2013-12-09 11:23:33,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 466ccce3 >2013-12-09 11:23:34,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 466ccce3 >2013-12-09 11:23:34,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e90e05d >2013-12-09 11:23:34,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e90e05d >2013-12-09 11:23:39,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b6b9fa5 >2013-12-09 11:23:39,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b6b9fa5 >2013-12-09 11:23:39,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d8068e0 >2013-12-09 11:23:40,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d8068e0 >2013-12-09 11:23:45,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62dd8ff5 >2013-12-09 11:23:45,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 62dd8ff5 >2013-12-09 11:23:45,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b40cbba >2013-12-09 11:23:45,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b40cbba >2013-12-09 11:23:50,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73d37d2f >2013-12-09 11:23:51,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 73d37d2f >2013-12-09 11:23:51,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bf06c62 >2013-12-09 11:23:51,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1bf06c62 >2013-12-09 11:23:56,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ea8a215 >2013-12-09 11:23:57,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1ea8a215 >2013-12-09 11:23:57,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 105d2418 >2013-12-09 11:23:57,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 105d2418 >2013-12-09 11:24:02,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3902317 >2013-12-09 11:24:02,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3902317 >2013-12-09 11:24:02,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f77b56 >2013-12-09 11:24:03,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f77b56 >2013-12-09 11:24:08,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b723d3e >2013-12-09 11:24:08,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b723d3e >2013-12-09 11:24:08,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10a5446a >2013-12-09 11:24:08,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10a5446a >2013-12-09 11:24:10,037 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-3) [6d1f044] No up server in cluster >2013-12-09 11:24:10,037 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-3) [6d1f044] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:24:10,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 150682b4 >2013-12-09 11:24:10,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterTasksListVDSCommand, return: [], log id: 150682b4 >2013-12-09 11:24:14,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d22552d >2013-12-09 11:24:14,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d22552d >2013-12-09 11:24:14,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4525c50 >2013-12-09 11:24:14,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4525c50 >2013-12-09 11:24:19,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a110172 >2013-12-09 11:24:20,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3a110172 >2013-12-09 11:24:20,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c716e5f >2013-12-09 11:24:20,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c716e5f >2013-12-09 11:24:25,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40880172 >2013-12-09 11:24:26,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 40880172 >2013-12-09 11:24:26,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a845bb5 >2013-12-09 11:24:26,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a845bb5 >2013-12-09 11:24:31,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 520a8213 >2013-12-09 11:24:31,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 520a8213 >2013-12-09 11:24:31,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d0c50dd >2013-12-09 11:24:32,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d0c50dd >2013-12-09 11:24:37,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75866bcf >2013-12-09 11:24:37,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 75866bcf >2013-12-09 11:24:37,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5984ed22 >2013-12-09 11:24:37,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5984ed22 >2013-12-09 11:24:42,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60fa7a8b >2013-12-09 11:24:43,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 60fa7a8b >2013-12-09 11:24:43,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e2faf71 >2013-12-09 11:24:43,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e2faf71 >2013-12-09 11:24:48,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18212367 >2013-12-09 11:24:49,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 18212367 >2013-12-09 11:24:49,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ffa0d58 >2013-12-09 11:24:49,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ffa0d58 >2013-12-09 11:24:54,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59b90e69 >2013-12-09 11:24:55,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 59b90e69 >2013-12-09 11:24:55,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f03fd19 >2013-12-09 11:24:55,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f03fd19 >2013-12-09 11:25:00,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ac7a868 >2013-12-09 11:25:00,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ac7a868 >2013-12-09 11:25:00,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2162b605 >2013-12-09 11:25:01,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2162b605 >2013-12-09 11:25:06,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: af31e1c >2013-12-09 11:25:06,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: af31e1c >2013-12-09 11:25:06,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6fc48c46 >2013-12-09 11:25:06,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6fc48c46 >2013-12-09 11:25:10,313 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-42) No up server in cluster >2013-12-09 11:25:10,313 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-42) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:25:10,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f0bafe9 >2013-12-09 11:25:10,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterTasksListVDSCommand, return: [], log id: f0bafe9 >2013-12-09 11:25:11,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61066ef1 >2013-12-09 11:25:12,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 61066ef1 >2013-12-09 11:25:12,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68e1c0f3 >2013-12-09 11:25:12,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68e1c0f3 >2013-12-09 11:25:17,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f572c8c >2013-12-09 11:25:18,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f572c8c >2013-12-09 11:25:18,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ea0cd7f >2013-12-09 11:25:18,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ea0cd7f >2013-12-09 11:25:23,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3fb7f21e >2013-12-09 11:25:23,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3fb7f21e >2013-12-09 11:25:23,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52e2f3f0 >2013-12-09 11:25:24,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52e2f3f0 >2013-12-09 11:25:29,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54ecb38c >2013-12-09 11:25:29,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 54ecb38c >2013-12-09 11:25:29,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27111229 >2013-12-09 11:25:29,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27111229 >2013-12-09 11:25:34,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 420ae568 >2013-12-09 11:25:35,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 420ae568 >2013-12-09 11:25:35,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 153761bd >2013-12-09 11:25:35,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 153761bd >2013-12-09 11:25:40,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8139bca >2013-12-09 11:25:41,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 8139bca >2013-12-09 11:25:41,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d83dcdc >2013-12-09 11:25:41,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d83dcdc >2013-12-09 11:25:46,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6fd98ab9 >2013-12-09 11:25:46,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6fd98ab9 >2013-12-09 11:25:46,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 305a6d64 >2013-12-09 11:25:47,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 305a6d64 >2013-12-09 11:25:52,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 602edcf5 >2013-12-09 11:25:52,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 602edcf5 >2013-12-09 11:25:52,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f187642 >2013-12-09 11:25:53,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f187642 >2013-12-09 11:25:58,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 633987ce >2013-12-09 11:25:58,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 633987ce >2013-12-09 11:25:58,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d23b243 >2013-12-09 11:25:58,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d23b243 >2013-12-09 11:26:03,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 729273e3 >2013-12-09 11:26:04,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 729273e3 >2013-12-09 11:26:04,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d5f5e82 >2013-12-09 11:26:04,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d5f5e82 >2013-12-09 11:26:09,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 354d1f7c >2013-12-09 11:26:10,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 354d1f7c >2013-12-09 11:26:10,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3df2682c >2013-12-09 11:26:10,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3df2682c >2013-12-09 11:26:10,585 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-60) No up server in cluster >2013-12-09 11:26:10,585 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-60) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:26:10,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52a88bb6 >2013-12-09 11:26:10,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterTasksListVDSCommand, return: [], log id: 52a88bb6 >2013-12-09 11:26:15,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 239c813a >2013-12-09 11:26:15,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 239c813a >2013-12-09 11:26:15,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 888e84e >2013-12-09 11:26:16,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 888e84e >2013-12-09 11:26:21,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51e9e841 >2013-12-09 11:26:21,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 51e9e841 >2013-12-09 11:26:21,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18304bec >2013-12-09 11:26:21,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18304bec >2013-12-09 11:26:26,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6feca24d >2013-12-09 11:26:27,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6feca24d >2013-12-09 11:26:27,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6485000d >2013-12-09 11:26:27,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6485000d >2013-12-09 11:26:32,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44a53f43 >2013-12-09 11:26:33,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 44a53f43 >2013-12-09 11:26:33,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26c6a9ff >2013-12-09 11:26:33,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26c6a9ff >2013-12-09 11:26:38,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63e40573 >2013-12-09 11:26:39,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 63e40573 >2013-12-09 11:26:39,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e3dab57 >2013-12-09 11:26:39,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e3dab57 >2013-12-09 11:26:44,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 377638eb >2013-12-09 11:26:45,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 377638eb >2013-12-09 11:26:45,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f475660 >2013-12-09 11:26:45,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f475660 >2013-12-09 11:26:50,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 225cdd2a >2013-12-09 11:26:51,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 225cdd2a >2013-12-09 11:26:51,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b25ca92 >2013-12-09 11:26:51,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b25ca92 >2013-12-09 11:26:56,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76c5d684 >2013-12-09 11:26:56,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 76c5d684 >2013-12-09 11:26:56,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 83e6c3d >2013-12-09 11:26:57,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 83e6c3d >2013-12-09 11:27:02,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f0298fb >2013-12-09 11:27:02,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f0298fb >2013-12-09 11:27:02,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21fcc1e6 >2013-12-09 11:27:02,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21fcc1e6 >2013-12-09 11:27:07,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 629a2253 >2013-12-09 11:27:08,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 629a2253 >2013-12-09 11:27:08,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f3b43ac >2013-12-09 11:27:08,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f3b43ac >2013-12-09 11:27:10,870 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-66) No up server in cluster >2013-12-09 11:27:10,870 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-66) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:27:10,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17edc12b >2013-12-09 11:27:11,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterTasksListVDSCommand, return: [], log id: 17edc12b >2013-12-09 11:27:13,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 377a89a7 >2013-12-09 11:27:14,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 377a89a7 >2013-12-09 11:27:14,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1dd90612 >2013-12-09 11:27:14,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1dd90612 >2013-12-09 11:27:19,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4db89384 >2013-12-09 11:27:20,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4db89384 >2013-12-09 11:27:20,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68079ef2 >2013-12-09 11:27:20,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68079ef2 >2013-12-09 11:27:25,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63c65800 >2013-12-09 11:27:25,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 63c65800 >2013-12-09 11:27:25,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 594ab74b >2013-12-09 11:27:26,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 594ab74b >2013-12-09 11:27:31,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72be786d >2013-12-09 11:27:31,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 72be786d >2013-12-09 11:27:31,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 394008a4 >2013-12-09 11:27:31,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 394008a4 >2013-12-09 11:27:36,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19559e2f >2013-12-09 11:27:37,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19559e2f >2013-12-09 11:27:37,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c035fbf >2013-12-09 11:27:37,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c035fbf >2013-12-09 11:27:42,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2cf321c9 >2013-12-09 11:27:43,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2cf321c9 >2013-12-09 11:27:43,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 686962d9 >2013-12-09 11:27:43,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 686962d9 >2013-12-09 11:27:48,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42a725d0 >2013-12-09 11:27:48,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 42a725d0 >2013-12-09 11:27:48,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f7f1d78 >2013-12-09 11:27:49,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f7f1d78 >2013-12-09 11:27:54,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e43ad75 >2013-12-09 11:27:54,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7e43ad75 >2013-12-09 11:27:54,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2da1f119 >2013-12-09 11:27:54,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2da1f119 >2013-12-09 11:27:59,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52a9ab66 >2013-12-09 11:28:00,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 52a9ab66 >2013-12-09 11:28:00,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c052d9f >2013-12-09 11:28:00,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c052d9f >2013-12-09 11:28:05,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7374a0f4 >2013-12-09 11:28:06,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7374a0f4 >2013-12-09 11:28:06,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7168ca66 >2013-12-09 11:28:06,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7168ca66 >2013-12-09 11:28:11,147 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-69) No up server in cluster >2013-12-09 11:28:11,147 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-69) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:28:11,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f0c51ae >2013-12-09 11:28:11,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2f0c51ae >2013-12-09 11:28:11,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79895c3a >2013-12-09 11:28:11,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 79895c3a >2013-12-09 11:28:11,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6bb649d9 >2013-12-09 11:28:12,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6bb649d9 >2013-12-09 11:28:17,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3bd13ddc >2013-12-09 11:28:17,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3bd13ddc >2013-12-09 11:28:17,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1acacda2 >2013-12-09 11:28:18,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1acacda2 >2013-12-09 11:28:23,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1089f99b >2013-12-09 11:28:23,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1089f99b >2013-12-09 11:28:23,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2527f703 >2013-12-09 11:28:23,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2527f703 >2013-12-09 11:28:28,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 509702ac >2013-12-09 11:28:29,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 509702ac >2013-12-09 11:28:29,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: efa2669 >2013-12-09 11:28:29,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: efa2669 >2013-12-09 11:28:34,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59b55b43 >2013-12-09 11:28:35,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59b55b43 >2013-12-09 11:28:35,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40bf0d60 >2013-12-09 11:28:35,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40bf0d60 >2013-12-09 11:28:40,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7275e944 >2013-12-09 11:28:40,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7275e944 >2013-12-09 11:28:40,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ba8833d >2013-12-09 11:28:41,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ba8833d >2013-12-09 11:28:46,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e3bba24 >2013-12-09 11:28:46,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3e3bba24 >2013-12-09 11:28:46,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f6d5859 >2013-12-09 11:28:46,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f6d5859 >2013-12-09 11:28:51,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17ae5b5 >2013-12-09 11:28:52,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 17ae5b5 >2013-12-09 11:28:52,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f05f6d4 >2013-12-09 11:28:52,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f05f6d4 >2013-12-09 11:28:57,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c2353d7 >2013-12-09 11:28:58,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c2353d7 >2013-12-09 11:28:58,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23ecfa5c >2013-12-09 11:28:58,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23ecfa5c >2013-12-09 11:29:03,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ed5c53d >2013-12-09 11:29:04,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ed5c53d >2013-12-09 11:29:04,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ef5c3aa >2013-12-09 11:29:04,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ef5c3aa >2013-12-09 11:29:09,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7299a840 >2013-12-09 11:29:09,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7299a840 >2013-12-09 11:29:09,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ebe23d0 >2013-12-09 11:29:10,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ebe23d0 >2013-12-09 11:29:11,424 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) No up server in cluster >2013-12-09 11:29:11,424 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:29:11,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1cc77fc5 >2013-12-09 11:29:11,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1cc77fc5 >2013-12-09 11:29:15,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 108b1c88 >2013-12-09 11:29:15,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 108b1c88 >2013-12-09 11:29:15,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34e03c39 >2013-12-09 11:29:15,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34e03c39 >2013-12-09 11:29:20,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27333c4 >2013-12-09 11:29:21,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 27333c4 >2013-12-09 11:29:21,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68e1461c >2013-12-09 11:29:21,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68e1461c >2013-12-09 11:29:26,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b1c3def >2013-12-09 11:29:27,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b1c3def >2013-12-09 11:29:27,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52afde40 >2013-12-09 11:29:27,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52afde40 >2013-12-09 11:29:32,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 141c6b59 >2013-12-09 11:29:32,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 141c6b59 >2013-12-09 11:29:32,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 361e3e2a >2013-12-09 11:29:33,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 361e3e2a >2013-12-09 11:29:38,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c4ac01d >2013-12-09 11:29:38,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c4ac01d >2013-12-09 11:29:38,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30487ebe >2013-12-09 11:29:38,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30487ebe >2013-12-09 11:29:43,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f18c294 >2013-12-09 11:29:44,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f18c294 >2013-12-09 11:29:44,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c5234b8 >2013-12-09 11:29:44,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c5234b8 >2013-12-09 11:29:49,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 465f734b >2013-12-09 11:29:50,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 465f734b >2013-12-09 11:29:50,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32e969b9 >2013-12-09 11:29:50,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32e969b9 >2013-12-09 11:29:55,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60441dbd >2013-12-09 11:29:56,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 60441dbd >2013-12-09 11:29:56,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e59f21e >2013-12-09 11:29:56,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e59f21e >2013-12-09 11:30:01,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63fc014d >2013-12-09 11:30:01,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 63fc014d >2013-12-09 11:30:01,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 99ff9d >2013-12-09 11:30:02,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 99ff9d >2013-12-09 11:30:07,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 22858209 >2013-12-09 11:30:07,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 22858209 >2013-12-09 11:30:07,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a73b3f6 >2013-12-09 11:30:07,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a73b3f6 >2013-12-09 11:30:11,698 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) No up server in cluster >2013-12-09 11:30:11,698 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:30:11,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a0a4b58 >2013-12-09 11:30:11,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1a0a4b58 >2013-12-09 11:30:12,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f722b9f >2013-12-09 11:30:13,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f722b9f >2013-12-09 11:30:13,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d44caa7 >2013-12-09 11:30:13,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d44caa7 >2013-12-09 11:30:18,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3dba2620 >2013-12-09 11:30:19,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3dba2620 >2013-12-09 11:30:19,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fc81fa5 >2013-12-09 11:30:19,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fc81fa5 >2013-12-09 11:30:24,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3568272e >2013-12-09 11:30:24,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3568272e >2013-12-09 11:30:24,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7bcdbf03 >2013-12-09 11:30:25,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7bcdbf03 >2013-12-09 11:30:30,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27bf6340 >2013-12-09 11:30:30,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 27bf6340 >2013-12-09 11:30:30,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c44b712 >2013-12-09 11:30:30,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c44b712 >2013-12-09 11:30:35,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fbf669c >2013-12-09 11:30:36,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2fbf669c >2013-12-09 11:30:36,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 183c4e45 >2013-12-09 11:30:36,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 183c4e45 >2013-12-09 11:30:41,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7459721e >2013-12-09 11:30:42,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7459721e >2013-12-09 11:30:42,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ea809a1 >2013-12-09 11:30:42,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ea809a1 >2013-12-09 11:30:47,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c386625 >2013-12-09 11:30:48,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c386625 >2013-12-09 11:30:48,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51bb9df2 >2013-12-09 11:30:48,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51bb9df2 >2013-12-09 11:30:53,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 324dbd17 >2013-12-09 11:30:53,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 324dbd17 >2013-12-09 11:30:53,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b16f701 >2013-12-09 11:30:54,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b16f701 >2013-12-09 11:30:59,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32819cc1 >2013-12-09 11:30:59,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 32819cc1 >2013-12-09 11:30:59,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f2b694f >2013-12-09 11:30:59,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f2b694f >2013-12-09 11:31:04,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50a4a4f0 >2013-12-09 11:31:05,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 50a4a4f0 >2013-12-09 11:31:05,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a338725 >2013-12-09 11:31:05,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a338725 >2013-12-09 11:31:10,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c9022d4 >2013-12-09 11:31:11,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c9022d4 >2013-12-09 11:31:11,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fe8fc99 >2013-12-09 11:31:11,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2fe8fc99 >2013-12-09 11:31:11,987 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-15) No up server in cluster >2013-12-09 11:31:11,988 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-15) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:31:11,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a6b2482 >2013-12-09 11:31:12,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3a6b2482 >2013-12-09 11:31:16,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 271c0177 >2013-12-09 11:31:17,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 271c0177 >2013-12-09 11:31:17,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d9cb421 >2013-12-09 11:31:17,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d9cb421 >2013-12-09 11:31:22,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35aca511 >2013-12-09 11:31:22,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 35aca511 >2013-12-09 11:31:22,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e7d16ae >2013-12-09 11:31:23,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e7d16ae >2013-12-09 11:31:28,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58c9b265 >2013-12-09 11:31:28,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 58c9b265 >2013-12-09 11:31:28,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a2585a3 >2013-12-09 11:31:28,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a2585a3 >2013-12-09 11:31:33,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d53b1bd >2013-12-09 11:31:34,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d53b1bd >2013-12-09 11:31:34,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e2bd089 >2013-12-09 11:31:34,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e2bd089 >2013-12-09 11:31:39,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f44faa2 >2013-12-09 11:31:40,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f44faa2 >2013-12-09 11:31:40,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13899ec8 >2013-12-09 11:31:40,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13899ec8 >2013-12-09 11:31:45,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51908ad0 >2013-12-09 11:31:45,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 51908ad0 >2013-12-09 11:31:45,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3421e58d >2013-12-09 11:31:46,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3421e58d >2013-12-09 11:31:51,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d44375c >2013-12-09 11:31:51,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d44375c >2013-12-09 11:31:51,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e6805c0 >2013-12-09 11:31:51,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e6805c0 >2013-12-09 11:31:56,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ecde272 >2013-12-09 11:31:57,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1ecde272 >2013-12-09 11:31:57,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2749c5a3 >2013-12-09 11:31:57,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2749c5a3 >2013-12-09 11:32:02,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37d6640d >2013-12-09 11:32:03,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 37d6640d >2013-12-09 11:32:03,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 381fcd02 >2013-12-09 11:32:03,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 381fcd02 >2013-12-09 11:32:08,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71784b3d >2013-12-09 11:32:09,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 71784b3d >2013-12-09 11:32:09,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52bedba0 >2013-12-09 11:32:09,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52bedba0 >2013-12-09 11:32:12,267 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-71) No up server in cluster >2013-12-09 11:32:12,267 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-71) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:32:12,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e94ac81 >2013-12-09 11:32:12,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterTasksListVDSCommand, return: [], log id: e94ac81 >2013-12-09 11:32:14,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 659a7c3f >2013-12-09 11:32:14,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 659a7c3f >2013-12-09 11:32:14,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a89304f >2013-12-09 11:32:15,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a89304f >2013-12-09 11:32:20,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2178fda0 >2013-12-09 11:32:20,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2178fda0 >2013-12-09 11:32:20,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d528e46 >2013-12-09 11:32:20,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d528e46 >2013-12-09 11:32:25,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30ab005 >2013-12-09 11:32:26,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 30ab005 >2013-12-09 11:32:26,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24162ad7 >2013-12-09 11:32:26,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24162ad7 >2013-12-09 11:32:31,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2730c233 >2013-12-09 11:32:32,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2730c233 >2013-12-09 11:32:32,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f00c1ac >2013-12-09 11:32:32,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f00c1ac >2013-12-09 11:32:37,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d601e17 >2013-12-09 11:32:37,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d601e17 >2013-12-09 11:32:37,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2839c8c4 >2013-12-09 11:32:38,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2839c8c4 >2013-12-09 11:32:43,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9dbe8a4 >2013-12-09 11:32:43,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 9dbe8a4 >2013-12-09 11:32:43,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 350e9db3 >2013-12-09 11:32:43,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 350e9db3 >2013-12-09 11:32:48,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e3115b8 >2013-12-09 11:32:49,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4e3115b8 >2013-12-09 11:32:49,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4103c0e >2013-12-09 11:32:49,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4103c0e >2013-12-09 11:32:54,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d16e805 >2013-12-09 11:32:55,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d16e805 >2013-12-09 11:32:55,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ad1709c >2013-12-09 11:32:55,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ad1709c >2013-12-09 11:33:00,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: fb5e475 >2013-12-09 11:33:01,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: fb5e475 >2013-12-09 11:33:01,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5deac729 >2013-12-09 11:33:01,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5deac729 >2013-12-09 11:33:06,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 613d3ab6 >2013-12-09 11:33:06,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 613d3ab6 >2013-12-09 11:33:06,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 485d1eef >2013-12-09 11:33:07,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 485d1eef >2013-12-09 11:33:12,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e608f4e >2013-12-09 11:33:12,555 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-2) No up server in cluster >2013-12-09 11:33:12,555 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-2) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:33:12,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7908e6a2 >2013-12-09 11:33:12,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7e608f4e >2013-12-09 11:33:12,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a31449e >2013-12-09 11:33:12,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7908e6a2 >2013-12-09 11:33:12,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a31449e >2013-12-09 11:33:17,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c48366a >2013-12-09 11:33:18,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c48366a >2013-12-09 11:33:18,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ee965f1 >2013-12-09 11:33:18,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ee965f1 >2013-12-09 11:33:23,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 796cfd9e >2013-12-09 11:33:24,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 796cfd9e >2013-12-09 11:33:24,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2329561d >2013-12-09 11:33:24,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2329561d >2013-12-09 11:33:29,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10334b7b >2013-12-09 11:33:29,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 10334b7b >2013-12-09 11:33:29,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 514d8aa9 >2013-12-09 11:33:30,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 514d8aa9 >2013-12-09 11:33:35,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70a61956 >2013-12-09 11:33:35,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 70a61956 >2013-12-09 11:33:35,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18bdbb06 >2013-12-09 11:33:35,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18bdbb06 >2013-12-09 11:33:40,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52f16c84 >2013-12-09 11:33:41,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 52f16c84 >2013-12-09 11:33:41,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e88dd7b >2013-12-09 11:33:41,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e88dd7b >2013-12-09 11:33:46,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13b724cb >2013-12-09 11:33:47,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 13b724cb >2013-12-09 11:33:47,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c22c494 >2013-12-09 11:33:47,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c22c494 >2013-12-09 11:33:52,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46f8972b >2013-12-09 11:33:53,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 46f8972b >2013-12-09 11:33:53,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ab4aeba >2013-12-09 11:33:53,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ab4aeba >2013-12-09 11:33:58,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43fab688 >2013-12-09 11:33:58,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 43fab688 >2013-12-09 11:33:58,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43ed381d >2013-12-09 11:33:59,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43ed381d >2013-12-09 11:34:04,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79762d85 >2013-12-09 11:34:04,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 79762d85 >2013-12-09 11:34:04,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4efd46d2 >2013-12-09 11:34:04,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4efd46d2 >2013-12-09 11:34:09,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 547cf2ae >2013-12-09 11:34:10,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 547cf2ae >2013-12-09 11:34:10,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bfd5c91 >2013-12-09 11:34:10,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bfd5c91 >2013-12-09 11:34:12,813 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-16) No up server in cluster >2013-12-09 11:34:12,813 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-16) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:34:12,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6650648 >2013-12-09 11:34:13,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6650648 >2013-12-09 11:34:15,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67dc67cf >2013-12-09 11:34:16,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 67dc67cf >2013-12-09 11:34:16,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ee8e59c >2013-12-09 11:34:16,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ee8e59c >2013-12-09 11:34:21,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7516c044 >2013-12-09 11:34:21,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7516c044 >2013-12-09 11:34:21,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74ea1194 >2013-12-09 11:34:22,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74ea1194 >2013-12-09 11:34:27,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 393eef30 >2013-12-09 11:34:27,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 393eef30 >2013-12-09 11:34:27,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 658ce140 >2013-12-09 11:34:27,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 658ce140 >2013-12-09 11:34:32,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7491767c >2013-12-09 11:34:33,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7491767c >2013-12-09 11:34:33,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 370f5577 >2013-12-09 11:34:33,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 370f5577 >2013-12-09 11:34:38,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13c6597c >2013-12-09 11:34:39,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 13c6597c >2013-12-09 11:34:39,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 15fa984a >2013-12-09 11:34:39,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15fa984a >2013-12-09 11:34:44,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58679869 >2013-12-09 11:34:45,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 58679869 >2013-12-09 11:34:45,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42f9cdb7 >2013-12-09 11:34:45,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42f9cdb7 >2013-12-09 11:34:50,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72bf97f4 >2013-12-09 11:34:50,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 72bf97f4 >2013-12-09 11:34:50,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3191acff >2013-12-09 11:34:51,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3191acff >2013-12-09 11:34:56,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 731bdd23 >2013-12-09 11:34:56,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 731bdd23 >2013-12-09 11:34:56,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c272b32 >2013-12-09 11:34:56,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c272b32 >2013-12-09 11:35:01,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d88eb0c >2013-12-09 11:35:02,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d88eb0c >2013-12-09 11:35:02,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4926058c >2013-12-09 11:35:02,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4926058c >2013-12-09 11:35:07,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56464505 >2013-12-09 11:35:08,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 56464505 >2013-12-09 11:35:08,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5813f456 >2013-12-09 11:35:08,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5813f456 >2013-12-09 11:35:13,091 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-24) No up server in cluster >2013-12-09 11:35:13,091 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-24) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:35:13,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63032b0c >2013-12-09 11:35:13,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterTasksListVDSCommand, return: [], log id: 63032b0c >2013-12-09 11:35:13,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76509e1c >2013-12-09 11:35:13,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 76509e1c >2013-12-09 11:35:13,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 512196c6 >2013-12-09 11:35:14,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 512196c6 >2013-12-09 11:35:19,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5151a24f >2013-12-09 11:35:19,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5151a24f >2013-12-09 11:35:19,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 350b043a >2013-12-09 11:35:19,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 350b043a >2013-12-09 11:35:24,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bd6f9a7 >2013-12-09 11:35:25,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4bd6f9a7 >2013-12-09 11:35:25,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26ebd51 >2013-12-09 11:35:25,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26ebd51 >2013-12-09 11:35:30,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3da21fd3 >2013-12-09 11:35:31,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3da21fd3 >2013-12-09 11:35:31,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16abeb2 >2013-12-09 11:35:31,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16abeb2 >2013-12-09 11:35:36,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 427888f0 >2013-12-09 11:35:37,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 427888f0 >2013-12-09 11:35:37,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68462c2a >2013-12-09 11:35:37,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68462c2a >2013-12-09 11:35:42,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4342ff13 >2013-12-09 11:35:42,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4342ff13 >2013-12-09 11:35:42,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 432d7df4 >2013-12-09 11:35:43,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 432d7df4 >2013-12-09 11:35:48,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a1c7e3f >2013-12-09 11:35:48,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a1c7e3f >2013-12-09 11:35:48,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a20e9db >2013-12-09 11:35:48,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a20e9db >2013-12-09 11:35:53,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 483516c5 >2013-12-09 11:35:54,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 483516c5 >2013-12-09 11:35:54,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7904cede >2013-12-09 11:35:54,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7904cede >2013-12-09 11:35:59,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43ffa8db >2013-12-09 11:36:00,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 43ffa8db >2013-12-09 11:36:00,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b6406b4 >2013-12-09 11:36:00,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b6406b4 >2013-12-09 11:36:05,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14f00701 >2013-12-09 11:36:05,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 14f00701 >2013-12-09 11:36:05,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13841a0d >2013-12-09 11:36:06,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13841a0d >2013-12-09 11:36:11,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3917763d >2013-12-09 11:36:11,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3917763d >2013-12-09 11:36:11,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44bee498 >2013-12-09 11:36:12,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44bee498 >2013-12-09 11:36:13,379 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-63) No up server in cluster >2013-12-09 11:36:13,379 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-63) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:36:13,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 536cb1a >2013-12-09 11:36:13,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterTasksListVDSCommand, return: [], log id: 536cb1a >2013-12-09 11:36:17,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a1031f3 >2013-12-09 11:36:17,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: a1031f3 >2013-12-09 11:36:17,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: bf65b3a >2013-12-09 11:36:17,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: bf65b3a >2013-12-09 11:36:22,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c0d6533 >2013-12-09 11:36:23,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6c0d6533 >2013-12-09 11:36:23,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 544d43fe >2013-12-09 11:36:23,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 544d43fe >2013-12-09 11:36:28,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a1cd067 >2013-12-09 11:36:29,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7a1cd067 >2013-12-09 11:36:29,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30b8dc1 >2013-12-09 11:36:29,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30b8dc1 >2013-12-09 11:36:34,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3862105c >2013-12-09 11:36:34,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3862105c >2013-12-09 11:36:34,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e406c96 >2013-12-09 11:36:35,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e406c96 >2013-12-09 11:36:40,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79441f4b >2013-12-09 11:36:40,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 79441f4b >2013-12-09 11:36:40,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7855b2c2 >2013-12-09 11:36:40,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7855b2c2 >2013-12-09 11:36:45,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5827bc5 >2013-12-09 11:36:46,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5827bc5 >2013-12-09 11:36:46,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d3499d5 >2013-12-09 11:36:46,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d3499d5 >2013-12-09 11:36:51,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2bcbc040 >2013-12-09 11:36:52,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2bcbc040 >2013-12-09 11:36:52,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d395e82 >2013-12-09 11:36:52,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d395e82 >2013-12-09 11:36:57,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 404004a7 >2013-12-09 11:36:58,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 404004a7 >2013-12-09 11:36:58,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 774cbf25 >2013-12-09 11:36:58,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 774cbf25 >2013-12-09 11:37:03,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30d07c68 >2013-12-09 11:37:03,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 30d07c68 >2013-12-09 11:37:03,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 28e76bb4 >2013-12-09 11:37:04,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28e76bb4 >2013-12-09 11:37:09,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a5297e9 >2013-12-09 11:37:09,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a5297e9 >2013-12-09 11:37:09,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 288c8852 >2013-12-09 11:37:09,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 288c8852 >2013-12-09 11:37:13,646 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-89) No up server in cluster >2013-12-09 11:37:13,646 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-89) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:37:13,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 479ba1fb >2013-12-09 11:37:13,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterTasksListVDSCommand, return: [], log id: 479ba1fb >2013-12-09 11:37:14,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 310bc339 >2013-12-09 11:37:15,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 310bc339 >2013-12-09 11:37:15,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2cf2645c >2013-12-09 11:37:15,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2cf2645c >2013-12-09 11:37:20,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fc9cca7 >2013-12-09 11:37:21,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2fc9cca7 >2013-12-09 11:37:21,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ec93d30 >2013-12-09 11:37:21,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ec93d30 >2013-12-09 11:37:26,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: cda1de8 >2013-12-09 11:37:27,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: cda1de8 >2013-12-09 11:37:27,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d511914 >2013-12-09 11:37:27,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d511914 >2013-12-09 11:37:32,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7cf87f03 >2013-12-09 11:37:32,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7cf87f03 >2013-12-09 11:37:32,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5de63cb8 >2013-12-09 11:37:33,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5de63cb8 >2013-12-09 11:37:38,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24c68911 >2013-12-09 11:37:38,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 24c68911 >2013-12-09 11:37:38,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13068eb0 >2013-12-09 11:37:38,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13068eb0 >2013-12-09 11:37:43,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: fa6454b >2013-12-09 11:37:44,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: fa6454b >2013-12-09 11:37:44,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c440cd5 >2013-12-09 11:37:44,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c440cd5 >2013-12-09 11:37:49,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5dfa955e >2013-12-09 11:37:50,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5dfa955e >2013-12-09 11:37:50,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68c3c85b >2013-12-09 11:37:50,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68c3c85b >2013-12-09 11:37:55,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71750d59 >2013-12-09 11:37:55,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 71750d59 >2013-12-09 11:37:55,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a7a9bf7 >2013-12-09 11:37:56,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a7a9bf7 >2013-12-09 11:38:01,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 384a307 >2013-12-09 11:38:01,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 384a307 >2013-12-09 11:38:01,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62770bb6 >2013-12-09 11:38:02,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62770bb6 >2013-12-09 11:38:07,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 725b1a4d >2013-12-09 11:38:07,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 725b1a4d >2013-12-09 11:38:07,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6107582e >2013-12-09 11:38:07,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6107582e >2013-12-09 11:38:12,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40f7619f >2013-12-09 11:38:13,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 40f7619f >2013-12-09 11:38:13,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 659780fe >2013-12-09 11:38:13,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 659780fe >2013-12-09 11:38:13,938 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-57) No up server in cluster >2013-12-09 11:38:13,938 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-57) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:38:13,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34f1867b >2013-12-09 11:38:14,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterTasksListVDSCommand, return: [], log id: 34f1867b >2013-12-09 11:38:18,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f949aab >2013-12-09 11:38:19,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5f949aab >2013-12-09 11:38:19,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7dffd2d6 >2013-12-09 11:38:19,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7dffd2d6 >2013-12-09 11:38:24,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3035cac0 >2013-12-09 11:38:24,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3035cac0 >2013-12-09 11:38:24,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 757bfaf8 >2013-12-09 11:38:25,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 757bfaf8 >2013-12-09 11:38:30,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 585dbb65 >2013-12-09 11:38:30,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 585dbb65 >2013-12-09 11:38:30,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d333610 >2013-12-09 11:38:30,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d333610 >2013-12-09 11:38:35,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5037d39c >2013-12-09 11:38:36,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5037d39c >2013-12-09 11:38:36,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ac7584d >2013-12-09 11:38:36,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ac7584d >2013-12-09 11:38:41,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 535775e0 >2013-12-09 11:38:42,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 535775e0 >2013-12-09 11:38:42,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d1ed284 >2013-12-09 11:38:42,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d1ed284 >2013-12-09 11:38:47,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e965d0c >2013-12-09 11:38:48,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e965d0c >2013-12-09 11:38:48,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 371e6ab7 >2013-12-09 11:38:48,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 371e6ab7 >2013-12-09 11:38:53,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6383d647 >2013-12-09 11:38:53,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6383d647 >2013-12-09 11:38:53,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2180a4d4 >2013-12-09 11:38:54,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2180a4d4 >2013-12-09 11:38:59,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23c2fe9a >2013-12-09 11:38:59,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 23c2fe9a >2013-12-09 11:38:59,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1fb6180f >2013-12-09 11:38:59,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1fb6180f >2013-12-09 11:39:04,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b630bfd >2013-12-09 11:39:05,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b630bfd >2013-12-09 11:39:05,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66e3ec2 >2013-12-09 11:39:05,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66e3ec2 >2013-12-09 11:39:10,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2981f33d >2013-12-09 11:39:11,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2981f33d >2013-12-09 11:39:11,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58c31d60 >2013-12-09 11:39:11,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58c31d60 >2013-12-09 11:39:14,207 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-34) No up server in cluster >2013-12-09 11:39:14,207 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-34) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:39:14,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4533127f >2013-12-09 11:39:14,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4533127f >2013-12-09 11:39:16,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2abe7c48 >2013-12-09 11:39:16,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2abe7c48 >2013-12-09 11:39:16,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e95dae3 >2013-12-09 11:39:17,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e95dae3 >2013-12-09 11:39:22,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77a8b6b3 >2013-12-09 11:39:22,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 77a8b6b3 >2013-12-09 11:39:22,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 501dede1 >2013-12-09 11:39:22,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 501dede1 >2013-12-09 11:39:27,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: dce7d5a >2013-12-09 11:39:28,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: dce7d5a >2013-12-09 11:39:28,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75ff4bd8 >2013-12-09 11:39:28,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75ff4bd8 >2013-12-09 11:39:33,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6222b31c >2013-12-09 11:39:34,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6222b31c >2013-12-09 11:39:34,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ed819f5 >2013-12-09 11:39:34,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ed819f5 >2013-12-09 11:39:39,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44df134d >2013-12-09 11:39:40,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 44df134d >2013-12-09 11:39:40,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ef4438b >2013-12-09 11:39:40,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ef4438b >2013-12-09 11:39:45,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d065037 >2013-12-09 11:39:45,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6d065037 >2013-12-09 11:39:45,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f105f7f >2013-12-09 11:39:46,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f105f7f >2013-12-09 11:39:51,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 220da561 >2013-12-09 11:39:51,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 220da561 >2013-12-09 11:39:51,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6fa052d9 >2013-12-09 11:39:51,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6fa052d9 >2013-12-09 11:39:56,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ea832ed >2013-12-09 11:39:57,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5ea832ed >2013-12-09 11:39:57,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3cb0af51 >2013-12-09 11:39:57,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3cb0af51 >2013-12-09 11:40:02,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79cd75df >2013-12-09 11:40:03,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 79cd75df >2013-12-09 11:40:03,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d3ebae3 >2013-12-09 11:40:03,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d3ebae3 >2013-12-09 11:40:08,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c9da20e >2013-12-09 11:40:08,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1c9da20e >2013-12-09 11:40:08,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7fa92dcc >2013-12-09 11:40:09,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fa92dcc >2013-12-09 11:40:14,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30adbea1 >2013-12-09 11:40:14,486 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-38) No up server in cluster >2013-12-09 11:40:14,486 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-38) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:40:14,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 695bd933 >2013-12-09 11:40:14,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 30adbea1 >2013-12-09 11:40:14,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 709409c2 >2013-12-09 11:40:14,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterTasksListVDSCommand, return: [], log id: 695bd933 >2013-12-09 11:40:14,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 709409c2 >2013-12-09 11:40:20,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f3e909b >2013-12-09 11:40:20,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: f3e909b >2013-12-09 11:40:20,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e9f9dbb >2013-12-09 11:40:20,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e9f9dbb >2013-12-09 11:40:25,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c343f6f >2013-12-09 11:40:26,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c343f6f >2013-12-09 11:40:26,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 400b08dd >2013-12-09 11:40:26,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 400b08dd >2013-12-09 11:40:31,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b64319d >2013-12-09 11:40:32,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b64319d >2013-12-09 11:40:32,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6900a0b7 >2013-12-09 11:40:32,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6900a0b7 >2013-12-09 11:40:37,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ce2bd74 >2013-12-09 11:40:37,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ce2bd74 >2013-12-09 11:40:37,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3fbcd397 >2013-12-09 11:40:38,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3fbcd397 >2013-12-09 11:40:43,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43897349 >2013-12-09 11:40:43,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 43897349 >2013-12-09 11:40:43,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b911f2f >2013-12-09 11:40:43,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b911f2f >2013-12-09 11:40:48,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 201b00b6 >2013-12-09 11:40:49,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 201b00b6 >2013-12-09 11:40:49,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 552fb95c >2013-12-09 11:40:49,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 552fb95c >2013-12-09 11:40:54,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c49ad3f >2013-12-09 11:40:55,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c49ad3f >2013-12-09 11:40:55,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47718d8b >2013-12-09 11:40:55,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47718d8b >2013-12-09 11:41:00,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40138368 >2013-12-09 11:41:00,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 40138368 >2013-12-09 11:41:00,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5670659a >2013-12-09 11:41:01,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5670659a >2013-12-09 11:41:06,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17668f59 >2013-12-09 11:41:06,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 17668f59 >2013-12-09 11:41:06,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f1994a >2013-12-09 11:41:07,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f1994a >2013-12-09 11:41:12,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40dec024 >2013-12-09 11:41:12,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 40dec024 >2013-12-09 11:41:12,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: db2910a >2013-12-09 11:41:12,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: db2910a >2013-12-09 11:41:14,757 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-32) No up server in cluster >2013-12-09 11:41:14,757 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-32) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:41:14,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d85b0a1 >2013-12-09 11:41:15,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5d85b0a1 >2013-12-09 11:41:17,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66db8cb2 >2013-12-09 11:41:18,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 66db8cb2 >2013-12-09 11:41:18,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5dec3aa5 >2013-12-09 11:41:18,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5dec3aa5 >2013-12-09 11:41:23,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b2c0d00 >2013-12-09 11:41:24,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5b2c0d00 >2013-12-09 11:41:24,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45abb097 >2013-12-09 11:41:24,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45abb097 >2013-12-09 11:41:29,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f86769 >2013-12-09 11:41:29,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6f86769 >2013-12-09 11:41:29,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f1c9d39 >2013-12-09 11:41:30,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f1c9d39 >2013-12-09 11:41:35,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c940937 >2013-12-09 11:41:35,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: c940937 >2013-12-09 11:41:35,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ca96034 >2013-12-09 11:41:35,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ca96034 >2013-12-09 11:41:40,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 759666e9 >2013-12-09 11:41:41,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 759666e9 >2013-12-09 11:41:41,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 766d3ac8 >2013-12-09 11:41:41,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 766d3ac8 >2013-12-09 11:41:46,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 319b85fe >2013-12-09 11:41:47,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 319b85fe >2013-12-09 11:41:47,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bb63941 >2013-12-09 11:41:47,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bb63941 >2013-12-09 11:41:52,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31d3ea42 >2013-12-09 11:41:53,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 31d3ea42 >2013-12-09 11:41:53,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65b06430 >2013-12-09 11:41:53,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65b06430 >2013-12-09 11:41:58,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17b30cda >2013-12-09 11:41:58,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 17b30cda >2013-12-09 11:41:58,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72e5348b >2013-12-09 11:41:59,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72e5348b >2013-12-09 11:42:04,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 514b02a6 >2013-12-09 11:42:04,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 514b02a6 >2013-12-09 11:42:04,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31105941 >2013-12-09 11:42:04,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31105941 >2013-12-09 11:42:09,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b22de8c >2013-12-09 11:42:10,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3b22de8c >2013-12-09 11:42:10,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31ed51ac >2013-12-09 11:42:10,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31ed51ac >2013-12-09 11:42:15,034 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-72) No up server in cluster >2013-12-09 11:42:15,034 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-72) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:42:15,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d28b3b4 >2013-12-09 11:42:15,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1d28b3b4 >2013-12-09 11:42:15,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6109b8ad >2013-12-09 11:42:16,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6109b8ad >2013-12-09 11:42:16,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b56a171 >2013-12-09 11:42:16,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b56a171 >2013-12-09 11:42:21,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 22912da8 >2013-12-09 11:42:22,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 22912da8 >2013-12-09 11:42:22,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f5c242c >2013-12-09 11:42:22,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f5c242c >2013-12-09 11:42:27,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66cc0287 >2013-12-09 11:42:27,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 66cc0287 >2013-12-09 11:42:27,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5af841cc >2013-12-09 11:42:28,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5af841cc >2013-12-09 11:42:33,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73fd072f >2013-12-09 11:42:33,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 73fd072f >2013-12-09 11:42:33,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 780c23d9 >2013-12-09 11:42:33,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 780c23d9 >2013-12-09 11:42:38,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1361cb80 >2013-12-09 11:42:39,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1361cb80 >2013-12-09 11:42:39,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4bb5f6a4 >2013-12-09 11:42:39,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4bb5f6a4 >2013-12-09 11:42:44,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1970b96d >2013-12-09 11:42:45,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1970b96d >2013-12-09 11:42:45,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69b4a13b >2013-12-09 11:42:45,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69b4a13b >2013-12-09 11:42:50,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b052660 >2013-12-09 11:42:50,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4b052660 >2013-12-09 11:42:50,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73e5ca91 >2013-12-09 11:42:51,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73e5ca91 >2013-12-09 11:42:56,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31e03f8 >2013-12-09 11:42:56,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 31e03f8 >2013-12-09 11:42:56,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76be16c9 >2013-12-09 11:42:56,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76be16c9 >2013-12-09 11:43:01,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e37ba95 >2013-12-09 11:43:02,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7e37ba95 >2013-12-09 11:43:02,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3634293e >2013-12-09 11:43:02,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3634293e >2013-12-09 11:43:07,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bfdfbbd >2013-12-09 11:43:08,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1bfdfbbd >2013-12-09 11:43:08,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d91aa3e >2013-12-09 11:43:08,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d91aa3e >2013-12-09 11:43:13,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4582215d >2013-12-09 11:43:13,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4582215d >2013-12-09 11:43:13,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c35890e >2013-12-09 11:43:14,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c35890e >2013-12-09 11:43:15,315 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-90) No up server in cluster >2013-12-09 11:43:15,315 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-90) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:43:15,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12c76d31 >2013-12-09 11:43:15,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterTasksListVDSCommand, return: [], log id: 12c76d31 >2013-12-09 11:43:19,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f173887 >2013-12-09 11:43:19,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7f173887 >2013-12-09 11:43:19,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5248d2f >2013-12-09 11:43:20,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5248d2f >2013-12-09 11:43:25,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18de1da8 >2013-12-09 11:43:25,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 18de1da8 >2013-12-09 11:43:25,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2223e886 >2013-12-09 11:43:25,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2223e886 >2013-12-09 11:43:30,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38064a2b >2013-12-09 11:43:31,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 38064a2b >2013-12-09 11:43:31,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27f69dd4 >2013-12-09 11:43:31,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27f69dd4 >2013-12-09 11:43:36,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4273c4c5 >2013-12-09 11:43:37,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4273c4c5 >2013-12-09 11:43:37,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b360ac0 >2013-12-09 11:43:37,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b360ac0 >2013-12-09 11:43:42,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b5498ea >2013-12-09 11:43:42,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b5498ea >2013-12-09 11:43:42,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f3dd264 >2013-12-09 11:43:43,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f3dd264 >2013-12-09 11:43:48,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8f14969 >2013-12-09 11:43:48,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 8f14969 >2013-12-09 11:43:48,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e6033d5 >2013-12-09 11:43:48,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e6033d5 >2013-12-09 11:43:53,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7dbd5010 >2013-12-09 11:43:54,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7dbd5010 >2013-12-09 11:43:54,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e71d854 >2013-12-09 11:43:54,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e71d854 >2013-12-09 11:43:59,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60c1077c >2013-12-09 11:44:00,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 60c1077c >2013-12-09 11:44:00,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b60fd6 >2013-12-09 11:44:00,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b60fd6 >2013-12-09 11:44:05,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 182f2a89 >2013-12-09 11:44:06,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 182f2a89 >2013-12-09 11:44:06,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f155ebd >2013-12-09 11:44:06,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f155ebd >2013-12-09 11:44:11,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 123564ae >2013-12-09 11:44:11,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 123564ae >2013-12-09 11:44:11,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 649ebff6 >2013-12-09 11:44:12,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 649ebff6 >2013-12-09 11:44:15,608 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-48) No up server in cluster >2013-12-09 11:44:15,608 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-48) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:44:15,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18181f8c >2013-12-09 11:44:15,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterTasksListVDSCommand, return: [], log id: 18181f8c >2013-12-09 11:44:17,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f0b731b >2013-12-09 11:44:17,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5f0b731b >2013-12-09 11:44:17,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 676079ff >2013-12-09 11:44:17,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 676079ff >2013-12-09 11:44:22,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1fc7efb1 >2013-12-09 11:44:23,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1fc7efb1 >2013-12-09 11:44:23,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d1b21a4 >2013-12-09 11:44:23,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d1b21a4 >2013-12-09 11:44:28,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2024c099 >2013-12-09 11:44:29,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2024c099 >2013-12-09 11:44:29,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d1fad3e >2013-12-09 11:44:29,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d1fad3e >2013-12-09 11:44:34,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f97d29a >2013-12-09 11:44:34,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f97d29a >2013-12-09 11:44:34,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3beb9a77 >2013-12-09 11:44:35,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3beb9a77 >2013-12-09 11:44:40,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60969bbe >2013-12-09 11:44:40,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 60969bbe >2013-12-09 11:44:40,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59bb9927 >2013-12-09 11:44:40,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59bb9927 >2013-12-09 11:44:45,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e272b17 >2013-12-09 11:44:46,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e272b17 >2013-12-09 11:44:46,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76409f4 >2013-12-09 11:44:46,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76409f4 >2013-12-09 11:44:51,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68fd43ab >2013-12-09 11:44:52,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 68fd43ab >2013-12-09 11:44:52,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41ea035e >2013-12-09 11:44:52,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41ea035e >2013-12-09 11:44:57,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23ada354 >2013-12-09 11:44:58,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 23ada354 >2013-12-09 11:44:58,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42ee6716 >2013-12-09 11:44:58,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42ee6716 >2013-12-09 11:45:03,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 299d33a5 >2013-12-09 11:45:03,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 299d33a5 >2013-12-09 11:45:03,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6145cc23 >2013-12-09 11:45:04,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6145cc23 >2013-12-09 11:45:09,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3489719c >2013-12-09 11:45:09,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3489719c >2013-12-09 11:45:09,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e617382 >2013-12-09 11:45:09,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e617382 >2013-12-09 11:45:14,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c9db75b >2013-12-09 11:45:15,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c9db75b >2013-12-09 11:45:15,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c2ae005 >2013-12-09 11:45:15,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c2ae005 >2013-12-09 11:45:15,895 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-19) No up server in cluster >2013-12-09 11:45:15,895 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-19) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:45:15,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55f5dd10 >2013-12-09 11:45:16,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterTasksListVDSCommand, return: [], log id: 55f5dd10 >2013-12-09 11:45:20,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 933c9d0 >2013-12-09 11:45:21,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 933c9d0 >2013-12-09 11:45:21,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1594e3d9 >2013-12-09 11:45:21,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1594e3d9 >2013-12-09 11:45:26,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 28dfebc5 >2013-12-09 11:45:26,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 28dfebc5 >2013-12-09 11:45:26,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7390f198 >2013-12-09 11:45:27,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7390f198 >2013-12-09 11:45:32,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ec3c64e >2013-12-09 11:45:32,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2ec3c64e >2013-12-09 11:45:32,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17a9cc3b >2013-12-09 11:45:32,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17a9cc3b >2013-12-09 11:45:37,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c29dbd5 >2013-12-09 11:45:38,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c29dbd5 >2013-12-09 11:45:38,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b082a3a >2013-12-09 11:45:38,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b082a3a >2013-12-09 11:45:43,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 409fa499 >2013-12-09 11:45:44,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 409fa499 >2013-12-09 11:45:44,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c021fc2 >2013-12-09 11:45:44,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c021fc2 >2013-12-09 11:45:49,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4657e78f >2013-12-09 11:45:50,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4657e78f >2013-12-09 11:45:50,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a6abe48 >2013-12-09 11:45:50,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a6abe48 >2013-12-09 11:45:55,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 342b2465 >2013-12-09 11:45:55,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 342b2465 >2013-12-09 11:45:55,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3bb171a7 >2013-12-09 11:45:56,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3bb171a7 >2013-12-09 11:46:01,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2058b63d >2013-12-09 11:46:01,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2058b63d >2013-12-09 11:46:01,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 439ec021 >2013-12-09 11:46:01,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 439ec021 >2013-12-09 11:46:06,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ce9979f >2013-12-09 11:46:07,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5ce9979f >2013-12-09 11:46:07,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7376999e >2013-12-09 11:46:07,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7376999e >2013-12-09 11:46:12,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b4126b2 >2013-12-09 11:46:13,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b4126b2 >2013-12-09 11:46:13,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29579c90 >2013-12-09 11:46:13,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29579c90 >2013-12-09 11:46:16,169 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-54) No up server in cluster >2013-12-09 11:46:16,170 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-54) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:46:16,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4be48f4d >2013-12-09 11:46:16,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4be48f4d >2013-12-09 11:46:18,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6af30912 >2013-12-09 11:46:18,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6af30912 >2013-12-09 11:46:18,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8bcffd5 >2013-12-09 11:46:19,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8bcffd5 >2013-12-09 11:46:24,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 760afc87 >2013-12-09 11:46:24,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 760afc87 >2013-12-09 11:46:24,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2311896c >2013-12-09 11:46:24,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2311896c >2013-12-09 11:46:29,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ddf88a9 >2013-12-09 11:46:30,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2ddf88a9 >2013-12-09 11:46:30,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 108357d4 >2013-12-09 11:46:30,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 108357d4 >2013-12-09 11:46:35,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 338998f4 >2013-12-09 11:46:36,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 338998f4 >2013-12-09 11:46:36,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f42c79e >2013-12-09 11:46:36,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f42c79e >2013-12-09 11:46:41,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7707da55 >2013-12-09 11:46:42,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7707da55 >2013-12-09 11:46:42,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b6f6e3f >2013-12-09 11:46:42,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b6f6e3f >2013-12-09 11:46:47,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13d0ef0e >2013-12-09 11:46:47,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 13d0ef0e >2013-12-09 11:46:47,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7311c1d1 >2013-12-09 11:46:48,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7311c1d1 >2013-12-09 11:46:53,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e7e0338 >2013-12-09 11:46:53,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7e7e0338 >2013-12-09 11:46:53,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2436e385 >2013-12-09 11:46:53,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2436e385 >2013-12-09 11:46:58,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 22019374 >2013-12-09 11:46:59,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 22019374 >2013-12-09 11:46:59,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 685170c7 >2013-12-09 11:46:59,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 685170c7 >2013-12-09 11:47:04,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6bd3515d >2013-12-09 11:47:05,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6bd3515d >2013-12-09 11:47:05,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3dab6f66 >2013-12-09 11:47:05,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3dab6f66 >2013-12-09 11:47:10,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53b1fb24 >2013-12-09 11:47:10,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 53b1fb24 >2013-12-09 11:47:10,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6db75954 >2013-12-09 11:47:11,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6db75954 >2013-12-09 11:47:16,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 397878ac >2013-12-09 11:47:16,445 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) No up server in cluster >2013-12-09 11:47:16,445 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:47:16,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 249ba3da >2013-12-09 11:47:16,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 397878ac >2013-12-09 11:47:16,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ae97b42 >2013-12-09 11:47:16,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterTasksListVDSCommand, return: [], log id: 249ba3da >2013-12-09 11:47:16,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ae97b42 >2013-12-09 11:47:21,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11cea534 >2013-12-09 11:47:22,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 11cea534 >2013-12-09 11:47:22,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27b16f97 >2013-12-09 11:47:22,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27b16f97 >2013-12-09 11:47:27,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d616895 >2013-12-09 11:47:28,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d616895 >2013-12-09 11:47:28,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35aafffd >2013-12-09 11:47:28,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35aafffd >2013-12-09 11:47:33,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b6002f5 >2013-12-09 11:47:34,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b6002f5 >2013-12-09 11:47:34,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c6b8ee9 >2013-12-09 11:47:34,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c6b8ee9 >2013-12-09 11:47:39,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f29b657 >2013-12-09 11:47:39,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f29b657 >2013-12-09 11:47:39,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f086cde >2013-12-09 11:47:40,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f086cde >2013-12-09 11:47:45,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d7b0cf2 >2013-12-09 11:47:45,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d7b0cf2 >2013-12-09 11:47:45,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: dc15a03 >2013-12-09 11:47:45,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: dc15a03 >2013-12-09 11:47:50,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ef764ae >2013-12-09 11:47:51,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ef764ae >2013-12-09 11:47:51,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49432f90 >2013-12-09 11:47:51,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49432f90 >2013-12-09 11:47:56,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b5ee5b4 >2013-12-09 11:47:57,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3b5ee5b4 >2013-12-09 11:47:57,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4fc60836 >2013-12-09 11:47:57,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fc60836 >2013-12-09 11:48:02,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 587ea8d4 >2013-12-09 11:48:03,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 587ea8d4 >2013-12-09 11:48:03,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a0dddbd >2013-12-09 11:48:03,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a0dddbd >2013-12-09 11:48:08,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7dab8184 >2013-12-09 11:48:08,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7dab8184 >2013-12-09 11:48:08,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34e3ca39 >2013-12-09 11:48:09,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34e3ca39 >2013-12-09 11:48:14,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: cb0b36a >2013-12-09 11:48:14,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: cb0b36a >2013-12-09 11:48:14,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55b82881 >2013-12-09 11:48:14,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55b82881 >2013-12-09 11:48:16,712 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-81) No up server in cluster >2013-12-09 11:48:16,712 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-81) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:48:16,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 15a354d2 >2013-12-09 11:48:16,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterTasksListVDSCommand, return: [], log id: 15a354d2 >2013-12-09 11:48:19,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4fb846d8 >2013-12-09 11:48:20,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4fb846d8 >2013-12-09 11:48:20,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23627f61 >2013-12-09 11:48:20,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23627f61 >2013-12-09 11:48:25,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c57206d >2013-12-09 11:48:26,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2c57206d >2013-12-09 11:48:26,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20b33d6b >2013-12-09 11:48:26,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20b33d6b >2013-12-09 11:48:31,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ee299ef >2013-12-09 11:48:31,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ee299ef >2013-12-09 11:48:31,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e3c194b >2013-12-09 11:48:32,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e3c194b >2013-12-09 11:48:37,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7681c49f >2013-12-09 11:48:37,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7681c49f >2013-12-09 11:48:37,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79bb1ede >2013-12-09 11:48:37,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79bb1ede >2013-12-09 11:48:42,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7863ba2 >2013-12-09 11:48:43,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7863ba2 >2013-12-09 11:48:43,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 651ee767 >2013-12-09 11:48:43,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 651ee767 >2013-12-09 11:48:48,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7862a289 >2013-12-09 11:48:49,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7862a289 >2013-12-09 11:48:49,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f7efcbc >2013-12-09 11:48:49,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f7efcbc >2013-12-09 11:48:54,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c992b9c >2013-12-09 11:48:55,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c992b9c >2013-12-09 11:48:55,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58275bd0 >2013-12-09 11:48:55,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58275bd0 >2013-12-09 11:49:00,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47285ef2 >2013-12-09 11:49:00,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 47285ef2 >2013-12-09 11:49:00,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c2b0d2d >2013-12-09 11:49:01,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c2b0d2d >2013-12-09 11:49:06,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 374c8f3f >2013-12-09 11:49:06,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 374c8f3f >2013-12-09 11:49:06,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73f80000 >2013-12-09 11:49:06,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73f80000 >2013-12-09 11:49:11,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 782ef701 >2013-12-09 11:49:12,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 782ef701 >2013-12-09 11:49:12,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67914b83 >2013-12-09 11:49:12,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67914b83 >2013-12-09 11:49:16,985 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-4) No up server in cluster >2013-12-09 11:49:16,985 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-4) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:49:16,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 129fae8f >2013-12-09 11:49:17,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterTasksListVDSCommand, return: [], log id: 129fae8f >2013-12-09 11:49:17,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17dcd288 >2013-12-09 11:49:18,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 17dcd288 >2013-12-09 11:49:18,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e23525d >2013-12-09 11:49:18,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e23525d >2013-12-09 11:49:23,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1774482a >2013-12-09 11:49:23,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1774482a >2013-12-09 11:49:23,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b865213 >2013-12-09 11:49:24,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b865213 >2013-12-09 11:49:29,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 794a5e1a >2013-12-09 11:49:29,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 794a5e1a >2013-12-09 11:49:29,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b57685e >2013-12-09 11:49:29,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b57685e >2013-12-09 11:49:34,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 153d9b87 >2013-12-09 11:49:35,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 153d9b87 >2013-12-09 11:49:35,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 514c61d8 >2013-12-09 11:49:35,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 514c61d8 >2013-12-09 11:49:40,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 222fd944 >2013-12-09 11:49:41,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 222fd944 >2013-12-09 11:49:41,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 734db3e5 >2013-12-09 11:49:41,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 734db3e5 >2013-12-09 11:49:46,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1009e444 >2013-12-09 11:49:46,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1009e444 >2013-12-09 11:49:46,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 197d77bb >2013-12-09 11:49:47,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 197d77bb >2013-12-09 11:49:52,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23277252 >2013-12-09 11:49:52,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 23277252 >2013-12-09 11:49:52,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c0a62ab >2013-12-09 11:49:53,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c0a62ab >2013-12-09 11:49:58,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8769765 >2013-12-09 11:49:58,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 8769765 >2013-12-09 11:49:58,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5da6365b >2013-12-09 11:49:58,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5da6365b >2013-12-09 11:50:03,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30038fd8 >2013-12-09 11:50:04,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 30038fd8 >2013-12-09 11:50:04,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a9279e0 >2013-12-09 11:50:04,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a9279e0 >2013-12-09 11:50:09,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f41c147 >2013-12-09 11:50:10,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f41c147 >2013-12-09 11:50:10,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78a2fde7 >2013-12-09 11:50:10,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78a2fde7 >2013-12-09 11:50:15,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56447daa >2013-12-09 11:50:15,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 56447daa >2013-12-09 11:50:15,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72ee2197 >2013-12-09 11:50:16,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72ee2197 >2013-12-09 11:50:17,266 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-29) No up server in cluster >2013-12-09 11:50:17,266 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-29) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:50:17,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 323fde7c >2013-12-09 11:50:17,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterTasksListVDSCommand, return: [], log id: 323fde7c >2013-12-09 11:50:21,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2913cd05 >2013-12-09 11:50:21,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2913cd05 >2013-12-09 11:50:21,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ac1c9db >2013-12-09 11:50:21,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ac1c9db >2013-12-09 11:50:26,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3fb230f9 >2013-12-09 11:50:27,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3fb230f9 >2013-12-09 11:50:27,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58be0cc3 >2013-12-09 11:50:27,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58be0cc3 >2013-12-09 11:50:32,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7334c4b6 >2013-12-09 11:50:33,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7334c4b6 >2013-12-09 11:50:33,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 225d0c3d >2013-12-09 11:50:33,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 225d0c3d >2013-12-09 11:50:38,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1178111d >2013-12-09 11:50:39,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1178111d >2013-12-09 11:50:39,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50eaf775 >2013-12-09 11:50:39,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50eaf775 >2013-12-09 11:50:44,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c9dce1a >2013-12-09 11:50:44,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c9dce1a >2013-12-09 11:50:44,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d22460a >2013-12-09 11:50:45,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d22460a >2013-12-09 11:50:50,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 83734c7 >2013-12-09 11:50:50,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 83734c7 >2013-12-09 11:50:50,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d97d5ee >2013-12-09 11:50:50,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d97d5ee >2013-12-09 11:50:55,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47f55d51 >2013-12-09 11:50:56,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 47f55d51 >2013-12-09 11:50:56,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c68a6e9 >2013-12-09 11:50:56,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c68a6e9 >2013-12-09 11:51:01,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 551914b1 >2013-12-09 11:51:02,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 551914b1 >2013-12-09 11:51:02,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 622f687c >2013-12-09 11:51:02,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 622f687c >2013-12-09 11:51:07,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b81dbaa >2013-12-09 11:51:08,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b81dbaa >2013-12-09 11:51:08,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5fd6b6e2 >2013-12-09 11:51:08,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fd6b6e2 >2013-12-09 11:51:13,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c784315 >2013-12-09 11:51:13,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c784315 >2013-12-09 11:51:13,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13965b73 >2013-12-09 11:51:14,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13965b73 >2013-12-09 11:51:17,542 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-100) No up server in cluster >2013-12-09 11:51:17,542 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-100) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:51:17,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27956065 >2013-12-09 11:51:17,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterTasksListVDSCommand, return: [], log id: 27956065 >2013-12-09 11:51:19,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74538190 >2013-12-09 11:51:19,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 74538190 >2013-12-09 11:51:19,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 724ef6fd >2013-12-09 11:51:19,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 724ef6fd >2013-12-09 11:51:24,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46e49e36 >2013-12-09 11:51:25,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 46e49e36 >2013-12-09 11:51:25,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c17d0a1 >2013-12-09 11:51:25,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c17d0a1 >2013-12-09 11:51:30,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 273023bd >2013-12-09 11:51:31,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 273023bd >2013-12-09 11:51:31,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3676544d >2013-12-09 11:51:31,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3676544d >2013-12-09 11:51:36,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: df008a >2013-12-09 11:51:37,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: df008a >2013-12-09 11:51:37,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6beac3de >2013-12-09 11:51:37,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6beac3de >2013-12-09 11:51:42,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78ce9d3b >2013-12-09 11:51:42,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 78ce9d3b >2013-12-09 11:51:42,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 411ea415 >2013-12-09 11:51:43,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 411ea415 >2013-12-09 11:51:48,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a294a56 >2013-12-09 11:51:48,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4a294a56 >2013-12-09 11:51:48,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51fe1e5f >2013-12-09 11:51:48,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51fe1e5f >2013-12-09 11:51:53,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2622350b >2013-12-09 11:51:54,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2622350b >2013-12-09 11:51:54,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ccecabb >2013-12-09 11:51:54,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ccecabb >2013-12-09 11:51:59,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5128d9f9 >2013-12-09 11:52:00,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5128d9f9 >2013-12-09 11:52:00,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b116d9c >2013-12-09 11:52:00,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b116d9c >2013-12-09 11:52:05,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78fbd4ad >2013-12-09 11:52:05,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 78fbd4ad >2013-12-09 11:52:05,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6dfad27b >2013-12-09 11:52:06,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6dfad27b >2013-12-09 11:52:11,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1104d34e >2013-12-09 11:52:11,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1104d34e >2013-12-09 11:52:11,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61a111a9 >2013-12-09 11:52:11,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61a111a9 >2013-12-09 11:52:16,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e16a610 >2013-12-09 11:52:17,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1e16a610 >2013-12-09 11:52:17,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 678f60c9 >2013-12-09 11:52:17,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 678f60c9 >2013-12-09 11:52:17,839 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-52) No up server in cluster >2013-12-09 11:52:17,839 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-52) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:52:17,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73178b64 >2013-12-09 11:52:18,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterTasksListVDSCommand, return: [], log id: 73178b64 >2013-12-09 11:52:22,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3572bcd9 >2013-12-09 11:52:23,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3572bcd9 >2013-12-09 11:52:23,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a6f59a4 >2013-12-09 11:52:23,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a6f59a4 >2013-12-09 11:52:28,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6cef9d45 >2013-12-09 11:52:29,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6cef9d45 >2013-12-09 11:52:29,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e81cc03 >2013-12-09 11:52:29,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e81cc03 >2013-12-09 11:52:34,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 769c299f >2013-12-09 11:52:34,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 769c299f >2013-12-09 11:52:34,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d2f4347 >2013-12-09 11:52:35,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d2f4347 >2013-12-09 11:52:40,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17625bb6 >2013-12-09 11:52:40,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 17625bb6 >2013-12-09 11:52:40,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14d4b3f8 >2013-12-09 11:52:40,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14d4b3f8 >2013-12-09 11:52:45,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e768509 >2013-12-09 11:52:46,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2e768509 >2013-12-09 11:52:46,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67ebe0cd >2013-12-09 11:52:46,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67ebe0cd >2013-12-09 11:52:51,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a1f44d3 >2013-12-09 11:52:52,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a1f44d3 >2013-12-09 11:52:52,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72c6887b >2013-12-09 11:52:52,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72c6887b >2013-12-09 11:52:57,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7bf490e >2013-12-09 11:52:57,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7bf490e >2013-12-09 11:52:57,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27e2f479 >2013-12-09 11:52:58,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27e2f479 >2013-12-09 11:53:03,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65638474 >2013-12-09 11:53:03,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 65638474 >2013-12-09 11:53:03,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 321516f2 >2013-12-09 11:53:03,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 321516f2 >2013-12-09 11:53:08,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f1baf77 >2013-12-09 11:53:09,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5f1baf77 >2013-12-09 11:53:09,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48bd6848 >2013-12-09 11:53:09,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48bd6848 >2013-12-09 11:53:14,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62fbba40 >2013-12-09 11:53:15,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 62fbba40 >2013-12-09 11:53:15,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5042ca7a >2013-12-09 11:53:15,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5042ca7a >2013-12-09 11:53:18,113 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-42) No up server in cluster >2013-12-09 11:53:18,113 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-42) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:53:18,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e71e9ef >2013-12-09 11:53:18,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4e71e9ef >2013-12-09 11:53:20,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78208af >2013-12-09 11:53:21,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 78208af >2013-12-09 11:53:21,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53654615 >2013-12-09 11:53:21,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53654615 >2013-12-09 11:53:26,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45230669 >2013-12-09 11:53:26,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 45230669 >2013-12-09 11:53:26,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f1df5ae >2013-12-09 11:53:27,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f1df5ae >2013-12-09 11:53:32,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b31b9f8 >2013-12-09 11:53:32,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b31b9f8 >2013-12-09 11:53:32,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74f9e543 >2013-12-09 11:53:32,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74f9e543 >2013-12-09 11:53:37,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a8636cb >2013-12-09 11:53:38,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4a8636cb >2013-12-09 11:53:38,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3fedec77 >2013-12-09 11:53:38,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3fedec77 >2013-12-09 11:53:43,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79070524 >2013-12-09 11:53:44,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 79070524 >2013-12-09 11:53:44,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a83b272 >2013-12-09 11:53:44,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a83b272 >2013-12-09 11:53:49,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 178b57ed >2013-12-09 11:53:49,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 178b57ed >2013-12-09 11:53:49,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: fe1184 >2013-12-09 11:53:50,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: fe1184 >2013-12-09 11:53:55,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41c26e10 >2013-12-09 11:53:55,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 41c26e10 >2013-12-09 11:53:55,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ea6076 >2013-12-09 11:53:56,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ea6076 >2013-12-09 11:54:01,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 587f1bde >2013-12-09 11:54:01,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 587f1bde >2013-12-09 11:54:01,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 799a6b83 >2013-12-09 11:54:01,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 799a6b83 >2013-12-09 11:54:06,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4002197a >2013-12-09 11:54:07,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4002197a >2013-12-09 11:54:07,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2172ca9e >2013-12-09 11:54:07,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2172ca9e >2013-12-09 11:54:12,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 679076f >2013-12-09 11:54:13,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 679076f >2013-12-09 11:54:13,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38adc895 >2013-12-09 11:54:13,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38adc895 >2013-12-09 11:54:18,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7413e4cf >2013-12-09 11:54:18,392 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-31) No up server in cluster >2013-12-09 11:54:18,392 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-31) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:54:18,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 169f8ff6 >2013-12-09 11:54:18,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterTasksListVDSCommand, return: [], log id: 169f8ff6 >2013-12-09 11:54:18,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7413e4cf >2013-12-09 11:54:18,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 222d756e >2013-12-09 11:54:19,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 222d756e >2013-12-09 11:54:24,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 461ff5b3 >2013-12-09 11:54:24,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 461ff5b3 >2013-12-09 11:54:24,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36fa3db3 >2013-12-09 11:54:24,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36fa3db3 >2013-12-09 11:54:29,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a3c03be >2013-12-09 11:54:30,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2a3c03be >2013-12-09 11:54:30,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 700ce8a1 >2013-12-09 11:54:30,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 700ce8a1 >2013-12-09 11:54:35,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63b4df43 >2013-12-09 11:54:36,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 63b4df43 >2013-12-09 11:54:36,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a021dcf >2013-12-09 11:54:36,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a021dcf >2013-12-09 11:54:41,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50186437 >2013-12-09 11:54:41,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 50186437 >2013-12-09 11:54:41,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8004fa8 >2013-12-09 11:54:42,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8004fa8 >2013-12-09 11:54:47,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40652266 >2013-12-09 11:54:47,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 40652266 >2013-12-09 11:54:47,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3883b768 >2013-12-09 11:54:48,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3883b768 >2013-12-09 11:54:53,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2440381e >2013-12-09 11:54:53,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2440381e >2013-12-09 11:54:53,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e1722a3 >2013-12-09 11:54:53,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e1722a3 >2013-12-09 11:54:58,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61004656 >2013-12-09 11:54:59,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 61004656 >2013-12-09 11:54:59,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11f10cdf >2013-12-09 11:54:59,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11f10cdf >2013-12-09 11:55:04,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67e2817b >2013-12-09 11:55:05,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 67e2817b >2013-12-09 11:55:05,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: afb921e >2013-12-09 11:55:05,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: afb921e >2013-12-09 11:55:10,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f75479f >2013-12-09 11:55:10,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3f75479f >2013-12-09 11:55:10,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71915fce >2013-12-09 11:55:11,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71915fce >2013-12-09 11:55:16,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 686f2e87 >2013-12-09 11:55:16,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 686f2e87 >2013-12-09 11:55:16,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 174449d3 >2013-12-09 11:55:16,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 174449d3 >2013-12-09 11:55:18,657 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) No up server in cluster >2013-12-09 11:55:18,657 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:55:18,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5424ef63 >2013-12-09 11:55:18,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5424ef63 >2013-12-09 11:55:21,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39d36bf8 >2013-12-09 11:55:22,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 39d36bf8 >2013-12-09 11:55:22,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 165b9d07 >2013-12-09 11:55:22,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 165b9d07 >2013-12-09 11:55:27,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ec62ae3 >2013-12-09 11:55:28,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5ec62ae3 >2013-12-09 11:55:28,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e89a65f >2013-12-09 11:55:28,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e89a65f >2013-12-09 11:55:33,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 599b6c0 >2013-12-09 11:55:34,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 599b6c0 >2013-12-09 11:55:34,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1dd3f69f >2013-12-09 11:55:34,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1dd3f69f >2013-12-09 11:55:39,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c846fe4 >2013-12-09 11:55:39,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c846fe4 >2013-12-09 11:55:39,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4085ff62 >2013-12-09 11:55:40,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4085ff62 >2013-12-09 11:55:45,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 719691f1 >2013-12-09 11:55:45,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 719691f1 >2013-12-09 11:55:45,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 742131e7 >2013-12-09 11:55:45,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 742131e7 >2013-12-09 11:55:50,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55cd8ddb >2013-12-09 11:55:51,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 55cd8ddb >2013-12-09 11:55:51,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c083a37 >2013-12-09 11:55:51,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c083a37 >2013-12-09 11:55:56,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26bc68ca >2013-12-09 11:55:57,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 26bc68ca >2013-12-09 11:55:57,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b3be630 >2013-12-09 11:55:57,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b3be630 >2013-12-09 11:56:02,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55e0f3a2 >2013-12-09 11:56:02,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 55e0f3a2 >2013-12-09 11:56:03,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a84fd56 >2013-12-09 11:56:03,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a84fd56 >2013-12-09 11:56:08,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7668b3ef >2013-12-09 11:56:08,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7668b3ef >2013-12-09 11:56:08,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d16ec4d >2013-12-09 11:56:09,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d16ec4d >2013-12-09 11:56:14,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f01696e >2013-12-09 11:56:14,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f01696e >2013-12-09 11:56:14,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c407c2e >2013-12-09 11:56:14,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c407c2e >2013-12-09 11:56:18,935 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-53) No up server in cluster >2013-12-09 11:56:18,935 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-53) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:56:18,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ffeb0de >2013-12-09 11:56:19,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7ffeb0de >2013-12-09 11:56:19,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 81a0b88 >2013-12-09 11:56:20,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 81a0b88 >2013-12-09 11:56:20,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ab63044 >2013-12-09 11:56:20,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ab63044 >2013-12-09 11:56:25,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 626b59fa >2013-12-09 11:56:26,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 626b59fa >2013-12-09 11:56:26,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7dd7e2b2 >2013-12-09 11:56:26,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7dd7e2b2 >2013-12-09 11:56:31,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4fbcc429 >2013-12-09 11:56:31,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4fbcc429 >2013-12-09 11:56:31,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a1fbf7c >2013-12-09 11:56:32,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a1fbf7c >2013-12-09 11:56:37,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d910829 >2013-12-09 11:56:37,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6d910829 >2013-12-09 11:56:37,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57e882b5 >2013-12-09 11:56:37,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57e882b5 >2013-12-09 11:56:42,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6600bf6f >2013-12-09 11:56:43,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6600bf6f >2013-12-09 11:56:43,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4caab6bf >2013-12-09 11:56:43,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4caab6bf >2013-12-09 11:56:48,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5432c658 >2013-12-09 11:56:49,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5432c658 >2013-12-09 11:56:49,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39d533e8 >2013-12-09 11:56:49,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39d533e8 >2013-12-09 11:56:54,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 625f7d28 >2013-12-09 11:56:55,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 625f7d28 >2013-12-09 11:56:55,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54c206a7 >2013-12-09 11:56:55,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54c206a7 >2013-12-09 11:57:00,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1aa8a6e2 >2013-12-09 11:57:00,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1aa8a6e2 >2013-12-09 11:57:00,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f870fe7 >2013-12-09 11:57:01,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f870fe7 >2013-12-09 11:57:06,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3cfc78a1 >2013-12-09 11:57:06,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3cfc78a1 >2013-12-09 11:57:06,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20f7aa1a >2013-12-09 11:57:06,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20f7aa1a >2013-12-09 11:57:11,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 102afb14 >2013-12-09 11:57:12,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 102afb14 >2013-12-09 11:57:12,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c419253 >2013-12-09 11:57:12,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c419253 >2013-12-09 11:57:17,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 459b2048 >2013-12-09 11:57:18,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 459b2048 >2013-12-09 11:57:18,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43593ec3 >2013-12-09 11:57:18,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43593ec3 >2013-12-09 11:57:19,226 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2013-12-09 11:57:19,226 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:57:19,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14c065df >2013-12-09 11:57:19,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterTasksListVDSCommand, return: [], log id: 14c065df >2013-12-09 11:57:23,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57ef83f4 >2013-12-09 11:57:23,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 57ef83f4 >2013-12-09 11:57:23,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1edaa5e3 >2013-12-09 11:57:24,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1edaa5e3 >2013-12-09 11:57:29,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5435e5cb >2013-12-09 11:57:29,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5435e5cb >2013-12-09 11:57:29,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d8f4d95 >2013-12-09 11:57:30,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d8f4d95 >2013-12-09 11:57:35,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b088cdb >2013-12-09 11:57:35,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5b088cdb >2013-12-09 11:57:35,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 622862d6 >2013-12-09 11:57:35,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 622862d6 >2013-12-09 11:57:40,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19422cda >2013-12-09 11:57:41,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19422cda >2013-12-09 11:57:41,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4586f165 >2013-12-09 11:57:41,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4586f165 >2013-12-09 11:57:46,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64bc797a >2013-12-09 11:57:47,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 64bc797a >2013-12-09 11:57:47,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 24e6bf80 >2013-12-09 11:57:47,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24e6bf80 >2013-12-09 11:57:52,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59aa6334 >2013-12-09 11:57:52,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59aa6334 >2013-12-09 11:57:52,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2eebf431 >2013-12-09 11:57:53,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2eebf431 >2013-12-09 11:57:58,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a0627d9 >2013-12-09 11:57:58,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a0627d9 >2013-12-09 11:57:58,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14bc2d24 >2013-12-09 11:57:58,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14bc2d24 >2013-12-09 11:58:03,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9bb9867 >2013-12-09 11:58:04,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 9bb9867 >2013-12-09 11:58:04,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58482571 >2013-12-09 11:58:04,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58482571 >2013-12-09 11:58:09,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 636481f6 >2013-12-09 11:58:10,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 636481f6 >2013-12-09 11:58:10,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6fc1bbee >2013-12-09 11:58:10,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6fc1bbee >2013-12-09 11:58:15,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ffc4fea >2013-12-09 11:58:15,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1ffc4fea >2013-12-09 11:58:15,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25f14007 >2013-12-09 11:58:16,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25f14007 >2013-12-09 11:58:19,514 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-95) No up server in cluster >2013-12-09 11:58:19,514 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-95) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:58:19,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2093ce9 >2013-12-09 11:58:19,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2093ce9 >2013-12-09 11:58:21,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34bbcd29 >2013-12-09 11:58:21,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 34bbcd29 >2013-12-09 11:58:21,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a3f8475 >2013-12-09 11:58:22,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a3f8475 >2013-12-09 11:58:27,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23ee0c5a >2013-12-09 11:58:27,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 23ee0c5a >2013-12-09 11:58:27,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 419a579c >2013-12-09 11:58:27,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 419a579c >2013-12-09 11:58:32,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: edf46f2 >2013-12-09 11:58:33,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: edf46f2 >2013-12-09 11:58:33,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7532c151 >2013-12-09 11:58:33,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7532c151 >2013-12-09 11:58:38,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54657a21 >2013-12-09 11:58:39,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 54657a21 >2013-12-09 11:58:39,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15156933 >2013-12-09 11:58:39,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15156933 >2013-12-09 11:58:44,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20a542f2 >2013-12-09 11:58:44,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 20a542f2 >2013-12-09 11:58:44,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10657863 >2013-12-09 11:58:45,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10657863 >2013-12-09 11:58:50,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a9ba7da >2013-12-09 11:58:50,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a9ba7da >2013-12-09 11:58:50,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40be35a3 >2013-12-09 11:58:50,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40be35a3 >2013-12-09 11:58:55,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 622e53cf >2013-12-09 11:58:56,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 622e53cf >2013-12-09 11:58:56,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69f51d6 >2013-12-09 11:58:56,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69f51d6 >2013-12-09 11:59:01,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30aff9c1 >2013-12-09 11:59:02,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 30aff9c1 >2013-12-09 11:59:02,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d5e4949 >2013-12-09 11:59:02,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d5e4949 >2013-12-09 11:59:07,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c1edfc6 >2013-12-09 11:59:07,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1c1edfc6 >2013-12-09 11:59:07,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 724c54d0 >2013-12-09 11:59:08,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 724c54d0 >2013-12-09 11:59:13,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e270b7b >2013-12-09 11:59:13,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: e270b7b >2013-12-09 11:59:13,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f7ba3d9 >2013-12-09 11:59:14,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f7ba3d9 >2013-12-09 11:59:19,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 487e7eab >2013-12-09 11:59:19,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 487e7eab >2013-12-09 11:59:19,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e5543b4 >2013-12-09 11:59:19,784 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-98) No up server in cluster >2013-12-09 11:59:19,784 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-98) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 11:59:19,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c47fb2b >2013-12-09 11:59:19,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e5543b4 >2013-12-09 11:59:20,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1c47fb2b >2013-12-09 11:59:24,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 193771eb >2013-12-09 11:59:25,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 193771eb >2013-12-09 11:59:25,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75a812ca >2013-12-09 11:59:25,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75a812ca >2013-12-09 11:59:30,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d140be >2013-12-09 11:59:31,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5d140be >2013-12-09 11:59:31,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 561b6fa3 >2013-12-09 11:59:31,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 561b6fa3 >2013-12-09 11:59:36,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68e8adac >2013-12-09 11:59:36,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 68e8adac >2013-12-09 11:59:36,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48f1abd7 >2013-12-09 11:59:37,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48f1abd7 >2013-12-09 11:59:38,746 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-12) Attempting to update VMs/Templates Ovf. >2013-12-09 11:59:42,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 367b0741 >2013-12-09 11:59:42,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 367b0741 >2013-12-09 11:59:42,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5eae62c1 >2013-12-09 11:59:42,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5eae62c1 >2013-12-09 11:59:44,588 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-51) Start refreshing all users data >2013-12-09 11:59:47,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: be21e85 >2013-12-09 11:59:48,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: be21e85 >2013-12-09 11:59:48,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e78ca35 >2013-12-09 11:59:48,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e78ca35 >2013-12-09 11:59:53,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f8d26b >2013-12-09 11:59:54,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: f8d26b >2013-12-09 11:59:54,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6fe2a6fc >2013-12-09 11:59:54,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6fe2a6fc >2013-12-09 11:59:59,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29237b7a >2013-12-09 12:00:00,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 29237b7a >2013-12-09 12:00:00,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6cdafc0f >2013-12-09 12:00:00,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6cdafc0f >2013-12-09 12:00:05,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d5bce48 >2013-12-09 12:00:05,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d5bce48 >2013-12-09 12:00:05,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c5ba495 >2013-12-09 12:00:06,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c5ba495 >2013-12-09 12:00:11,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c792aff >2013-12-09 12:00:11,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c792aff >2013-12-09 12:00:11,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 755cfcf >2013-12-09 12:00:11,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 755cfcf >2013-12-09 12:00:16,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 25dc9c12 >2013-12-09 12:00:17,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 25dc9c12 >2013-12-09 12:00:17,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38628e7 >2013-12-09 12:00:17,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38628e7 >2013-12-09 12:00:20,077 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-90) No up server in cluster >2013-12-09 12:00:20,077 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-90) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:00:20,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 342de307 >2013-12-09 12:00:20,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterTasksListVDSCommand, return: [], log id: 342de307 >2013-12-09 12:00:22,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59021482 >2013-12-09 12:00:23,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59021482 >2013-12-09 12:00:23,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 326c2fd3 >2013-12-09 12:00:23,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 326c2fd3 >2013-12-09 12:00:28,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2884422a >2013-12-09 12:00:28,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2884422a >2013-12-09 12:00:28,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f976ef6 >2013-12-09 12:00:29,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f976ef6 >2013-12-09 12:00:34,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3049adb1 >2013-12-09 12:00:34,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3049adb1 >2013-12-09 12:00:34,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 666661bd >2013-12-09 12:00:35,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 666661bd >2013-12-09 12:00:40,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bd6c25b >2013-12-09 12:00:40,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2bd6c25b >2013-12-09 12:00:40,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e7b6b2 >2013-12-09 12:00:40,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e7b6b2 >2013-12-09 12:00:45,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32025757 >2013-12-09 12:00:46,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 32025757 >2013-12-09 12:00:46,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4eb48cf5 >2013-12-09 12:00:46,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4eb48cf5 >2013-12-09 12:00:51,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3adf18cf >2013-12-09 12:00:52,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3adf18cf >2013-12-09 12:00:52,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29d856c7 >2013-12-09 12:00:52,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29d856c7 >2013-12-09 12:00:57,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d212cf7 >2013-12-09 12:00:57,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d212cf7 >2013-12-09 12:00:57,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b7e7a09 >2013-12-09 12:00:58,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b7e7a09 >2013-12-09 12:01:03,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48a68191 >2013-12-09 12:01:03,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 48a68191 >2013-12-09 12:01:03,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1fe720d9 >2013-12-09 12:01:03,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1fe720d9 >2013-12-09 12:01:08,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c1ec5fb >2013-12-09 12:01:09,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c1ec5fb >2013-12-09 12:01:09,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 155c3629 >2013-12-09 12:01:09,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 155c3629 >2013-12-09 12:01:14,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5460258f >2013-12-09 12:01:15,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5460258f >2013-12-09 12:01:15,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f4af726 >2013-12-09 12:01:15,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f4af726 >2013-12-09 12:01:20,371 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-48) No up server in cluster >2013-12-09 12:01:20,371 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-48) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:01:20,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5fcbf03b >2013-12-09 12:01:20,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d2f70a6 >2013-12-09 12:01:20,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5fcbf03b >2013-12-09 12:01:20,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d2f70a6 >2013-12-09 12:01:20,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f226bda >2013-12-09 12:01:21,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f226bda >2013-12-09 12:01:26,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77dc763d >2013-12-09 12:01:26,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 77dc763d >2013-12-09 12:01:26,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 94510c5 >2013-12-09 12:01:26,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 94510c5 >2013-12-09 12:01:31,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a42139f >2013-12-09 12:01:32,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2a42139f >2013-12-09 12:01:32,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b645b55 >2013-12-09 12:01:32,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b645b55 >2013-12-09 12:01:37,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a4f8761 >2013-12-09 12:01:38,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6a4f8761 >2013-12-09 12:01:38,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c8b6581 >2013-12-09 12:01:38,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c8b6581 >2013-12-09 12:01:43,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bbf35d2 >2013-12-09 12:01:44,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4bbf35d2 >2013-12-09 12:01:44,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24af4bbc >2013-12-09 12:01:44,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24af4bbc >2013-12-09 12:01:49,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a2d931e >2013-12-09 12:01:49,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: a2d931e >2013-12-09 12:01:49,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32cf0faa >2013-12-09 12:01:50,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32cf0faa >2013-12-09 12:01:55,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bd71692 >2013-12-09 12:01:55,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2bd71692 >2013-12-09 12:01:55,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69f6ae19 >2013-12-09 12:01:55,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69f6ae19 >2013-12-09 12:02:00,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 526a19c6 >2013-12-09 12:02:01,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 526a19c6 >2013-12-09 12:02:01,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c31173a >2013-12-09 12:02:01,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c31173a >2013-12-09 12:02:06,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5bb2d8b0 >2013-12-09 12:02:07,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5bb2d8b0 >2013-12-09 12:02:07,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56a3b29e >2013-12-09 12:02:07,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56a3b29e >2013-12-09 12:02:12,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 634ead8a >2013-12-09 12:02:12,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 634ead8a >2013-12-09 12:02:12,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 489abffd >2013-12-09 12:02:13,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 489abffd >2013-12-09 12:02:18,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 90b836b >2013-12-09 12:02:18,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 90b836b >2013-12-09 12:02:18,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1767d55c >2013-12-09 12:02:18,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1767d55c >2013-12-09 12:02:20,618 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-19) No up server in cluster >2013-12-09 12:02:20,619 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-19) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:02:20,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 785899d3 >2013-12-09 12:02:20,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterTasksListVDSCommand, return: [], log id: 785899d3 >2013-12-09 12:02:23,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 143c3c2e >2013-12-09 12:02:24,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 143c3c2e >2013-12-09 12:02:24,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2fe0fe77 >2013-12-09 12:02:24,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2fe0fe77 >2013-12-09 12:02:29,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 390e663d >2013-12-09 12:02:30,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 390e663d >2013-12-09 12:02:30,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 725633c3 >2013-12-09 12:02:30,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 725633c3 >2013-12-09 12:02:35,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3cd6205d >2013-12-09 12:02:36,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3cd6205d >2013-12-09 12:02:36,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 545a3674 >2013-12-09 12:02:36,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 545a3674 >2013-12-09 12:02:41,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c4d63a5 >2013-12-09 12:02:41,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6c4d63a5 >2013-12-09 12:02:41,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36c44610 >2013-12-09 12:02:42,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36c44610 >2013-12-09 12:02:47,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f0dff54 >2013-12-09 12:02:47,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: f0dff54 >2013-12-09 12:02:47,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4bf4d91d >2013-12-09 12:02:47,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4bf4d91d >2013-12-09 12:02:52,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4077c56a >2013-12-09 12:02:53,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4077c56a >2013-12-09 12:02:53,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e0cb1e8 >2013-12-09 12:02:53,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e0cb1e8 >2013-12-09 12:02:58,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2579ac28 >2013-12-09 12:02:59,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2579ac28 >2013-12-09 12:02:59,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 370329f6 >2013-12-09 12:02:59,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 370329f6 >2013-12-09 12:03:04,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2320c61c >2013-12-09 12:03:05,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2320c61c >2013-12-09 12:03:05,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 181f55c1 >2013-12-09 12:03:05,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 181f55c1 >2013-12-09 12:03:10,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56e7f37f >2013-12-09 12:03:10,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 56e7f37f >2013-12-09 12:03:10,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b2939af >2013-12-09 12:03:11,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b2939af >2013-12-09 12:03:16,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e84850f >2013-12-09 12:03:16,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1e84850f >2013-12-09 12:03:16,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13129008 >2013-12-09 12:03:16,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13129008 >2013-12-09 12:03:20,906 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-24) No up server in cluster >2013-12-09 12:03:20,906 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-24) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:03:20,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6cca2463 >2013-12-09 12:03:21,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6cca2463 >2013-12-09 12:03:21,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16f7c34b >2013-12-09 12:03:22,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 16f7c34b >2013-12-09 12:03:22,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1faf7b67 >2013-12-09 12:03:22,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1faf7b67 >2013-12-09 12:03:27,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d8fc257 >2013-12-09 12:03:28,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d8fc257 >2013-12-09 12:03:28,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7168922e >2013-12-09 12:03:28,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7168922e >2013-12-09 12:03:33,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 312de4c6 >2013-12-09 12:03:33,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 312de4c6 >2013-12-09 12:03:33,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 493096b2 >2013-12-09 12:03:34,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 493096b2 >2013-12-09 12:03:39,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 22344688 >2013-12-09 12:03:39,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 22344688 >2013-12-09 12:03:39,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d604bb8 >2013-12-09 12:03:39,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d604bb8 >2013-12-09 12:03:44,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27ceab59 >2013-12-09 12:03:45,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 27ceab59 >2013-12-09 12:03:45,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77b0e7f >2013-12-09 12:03:45,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77b0e7f >2013-12-09 12:03:50,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56f45eca >2013-12-09 12:03:51,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 56f45eca >2013-12-09 12:03:51,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d493ca9 >2013-12-09 12:03:51,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d493ca9 >2013-12-09 12:03:56,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d25fe44 >2013-12-09 12:03:57,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d25fe44 >2013-12-09 12:03:57,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ada16a8 >2013-12-09 12:03:57,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ada16a8 >2013-12-09 12:04:02,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2583f723 >2013-12-09 12:04:02,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2583f723 >2013-12-09 12:04:02,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 306f2d1e >2013-12-09 12:04:03,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 306f2d1e >2013-12-09 12:04:08,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: eef4ba8 >2013-12-09 12:04:08,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: eef4ba8 >2013-12-09 12:04:08,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58bdfcf7 >2013-12-09 12:04:08,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58bdfcf7 >2013-12-09 12:04:13,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 24fa0b56 >2013-12-09 12:04:14,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 24fa0b56 >2013-12-09 12:04:14,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65f134a1 >2013-12-09 12:04:14,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65f134a1 >2013-12-09 12:04:19,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c3eb4c9 >2013-12-09 12:04:20,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c3eb4c9 >2013-12-09 12:04:20,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74e58148 >2013-12-09 12:04:20,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74e58148 >2013-12-09 12:04:21,176 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) No up server in cluster >2013-12-09 12:04:21,176 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:04:21,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 573a0679 >2013-12-09 12:04:21,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterTasksListVDSCommand, return: [], log id: 573a0679 >2013-12-09 12:04:25,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e63d5cc >2013-12-09 12:04:25,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e63d5cc >2013-12-09 12:04:25,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 560868c8 >2013-12-09 12:04:26,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 560868c8 >2013-12-09 12:04:31,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f359fe8 >2013-12-09 12:04:31,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f359fe8 >2013-12-09 12:04:31,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64a2fae1 >2013-12-09 12:04:32,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64a2fae1 >2013-12-09 12:04:37,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 407433e9 >2013-12-09 12:04:37,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 407433e9 >2013-12-09 12:04:37,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7666de2d >2013-12-09 12:04:37,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7666de2d >2013-12-09 12:04:42,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6136712 >2013-12-09 12:04:43,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6136712 >2013-12-09 12:04:43,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ca81b4d >2013-12-09 12:04:43,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ca81b4d >2013-12-09 12:04:48,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78f77f94 >2013-12-09 12:04:49,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 78f77f94 >2013-12-09 12:04:49,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3850c94c >2013-12-09 12:04:49,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3850c94c >2013-12-09 12:04:54,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c5868be >2013-12-09 12:04:54,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2c5868be >2013-12-09 12:04:54,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a3f970a >2013-12-09 12:04:55,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a3f970a >2013-12-09 12:05:00,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16dd0366 >2013-12-09 12:05:00,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 16dd0366 >2013-12-09 12:05:00,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3da8b9b8 >2013-12-09 12:05:00,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3da8b9b8 >2013-12-09 12:05:05,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bd8210e >2013-12-09 12:05:06,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1bd8210e >2013-12-09 12:05:06,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 984c5cb >2013-12-09 12:05:06,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 984c5cb >2013-12-09 12:05:11,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c365e46 >2013-12-09 12:05:12,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c365e46 >2013-12-09 12:05:12,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13f7fe62 >2013-12-09 12:05:12,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13f7fe62 >2013-12-09 12:05:17,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 672c514c >2013-12-09 12:05:18,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 672c514c >2013-12-09 12:05:18,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42ae92dc >2013-12-09 12:05:18,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42ae92dc >2013-12-09 12:05:21,459 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-81) No up server in cluster >2013-12-09 12:05:21,459 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-81) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:05:21,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11efe015 >2013-12-09 12:05:21,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterTasksListVDSCommand, return: [], log id: 11efe015 >2013-12-09 12:05:23,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67fd79ba >2013-12-09 12:05:23,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 67fd79ba >2013-12-09 12:05:23,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f7f6c60 >2013-12-09 12:05:24,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f7f6c60 >2013-12-09 12:05:29,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37333e9d >2013-12-09 12:05:29,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 37333e9d >2013-12-09 12:05:29,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3abc5ed3 >2013-12-09 12:05:29,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3abc5ed3 >2013-12-09 12:05:34,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3da64bb4 >2013-12-09 12:05:35,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3da64bb4 >2013-12-09 12:05:35,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 372a169a >2013-12-09 12:05:35,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 372a169a >2013-12-09 12:05:40,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d144c60 >2013-12-09 12:05:41,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4d144c60 >2013-12-09 12:05:41,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c8f8e83 >2013-12-09 12:05:41,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c8f8e83 >2013-12-09 12:05:46,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f8ea081 >2013-12-09 12:05:46,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1f8ea081 >2013-12-09 12:05:46,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f8b53d2 >2013-12-09 12:05:47,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f8b53d2 >2013-12-09 12:05:52,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6618b754 >2013-12-09 12:05:52,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6618b754 >2013-12-09 12:05:52,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48c2de82 >2013-12-09 12:05:53,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48c2de82 >2013-12-09 12:05:58,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f2d6df1 >2013-12-09 12:05:58,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7f2d6df1 >2013-12-09 12:05:58,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62a5082e >2013-12-09 12:05:58,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62a5082e >2013-12-09 12:06:03,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 245848d2 >2013-12-09 12:06:04,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 245848d2 >2013-12-09 12:06:04,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40807a6a >2013-12-09 12:06:04,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40807a6a >2013-12-09 12:06:09,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1db04eaa >2013-12-09 12:06:10,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1db04eaa >2013-12-09 12:06:10,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e61ac3a >2013-12-09 12:06:10,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e61ac3a >2013-12-09 12:06:15,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1450b607 >2013-12-09 12:06:15,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1450b607 >2013-12-09 12:06:15,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f97ed6d >2013-12-09 12:06:16,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f97ed6d >2013-12-09 12:06:21,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76784e8a >2013-12-09 12:06:21,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 76784e8a >2013-12-09 12:06:21,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 688d6ea6 >2013-12-09 12:06:21,741 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-99) No up server in cluster >2013-12-09 12:06:21,742 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-99) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:06:21,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 644f5452 >2013-12-09 12:06:21,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 688d6ea6 >2013-12-09 12:06:22,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterTasksListVDSCommand, return: [], log id: 644f5452 >2013-12-09 12:06:26,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b4c1fef >2013-12-09 12:06:27,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b4c1fef >2013-12-09 12:06:27,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6cf99790 >2013-12-09 12:06:27,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6cf99790 >2013-12-09 12:06:32,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32b96904 >2013-12-09 12:06:33,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 32b96904 >2013-12-09 12:06:33,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79620518 >2013-12-09 12:06:33,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79620518 >2013-12-09 12:06:38,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5846bf60 >2013-12-09 12:06:38,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5846bf60 >2013-12-09 12:06:38,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7333231b >2013-12-09 12:06:39,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7333231b >2013-12-09 12:06:44,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d23fe2e >2013-12-09 12:06:44,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6d23fe2e >2013-12-09 12:06:44,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e933b69 >2013-12-09 12:06:45,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e933b69 >2013-12-09 12:06:50,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e5b9696 >2013-12-09 12:06:50,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2e5b9696 >2013-12-09 12:06:50,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d533005 >2013-12-09 12:06:50,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d533005 >2013-12-09 12:06:55,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a2bc548 >2013-12-09 12:06:56,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3a2bc548 >2013-12-09 12:06:56,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ebeb21a >2013-12-09 12:06:56,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ebeb21a >2013-12-09 12:07:01,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: bb34e55 >2013-12-09 12:07:02,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: bb34e55 >2013-12-09 12:07:02,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e8b9485 >2013-12-09 12:07:02,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e8b9485 >2013-12-09 12:07:07,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 512b996f >2013-12-09 12:07:07,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 512b996f >2013-12-09 12:07:07,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6076533d >2013-12-09 12:07:08,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6076533d >2013-12-09 12:07:13,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67bade07 >2013-12-09 12:07:13,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 67bade07 >2013-12-09 12:07:13,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d1d896e >2013-12-09 12:07:13,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d1d896e >2013-12-09 12:07:18,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46117f64 >2013-12-09 12:07:19,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 46117f64 >2013-12-09 12:07:19,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32ceee49 >2013-12-09 12:07:19,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32ceee49 >2013-12-09 12:07:22,021 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-77) No up server in cluster >2013-12-09 12:07:22,021 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-77) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:07:22,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b84eca9 >2013-12-09 12:07:22,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5b84eca9 >2013-12-09 12:07:24,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50e289ca >2013-12-09 12:07:25,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 50e289ca >2013-12-09 12:07:25,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f2bf8e4 >2013-12-09 12:07:25,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f2bf8e4 >2013-12-09 12:07:30,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f5d3106 >2013-12-09 12:07:30,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5f5d3106 >2013-12-09 12:07:30,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ec6acfd >2013-12-09 12:07:31,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ec6acfd >2013-12-09 12:07:36,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4238d337 >2013-12-09 12:07:36,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4238d337 >2013-12-09 12:07:36,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2bcce08d >2013-12-09 12:07:36,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bcce08d >2013-12-09 12:07:42,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74515c2a >2013-12-09 12:07:42,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 74515c2a >2013-12-09 12:07:42,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ecee1f8 >2013-12-09 12:07:42,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ecee1f8 >2013-12-09 12:07:47,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51321bb3 >2013-12-09 12:07:48,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 51321bb3 >2013-12-09 12:07:48,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7411c185 >2013-12-09 12:07:48,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7411c185 >2013-12-09 12:07:53,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5959902e >2013-12-09 12:07:54,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5959902e >2013-12-09 12:07:54,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 592cd7a2 >2013-12-09 12:07:54,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 592cd7a2 >2013-12-09 12:07:59,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77ee7ae2 >2013-12-09 12:07:59,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 77ee7ae2 >2013-12-09 12:07:59,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c8338fd >2013-12-09 12:08:00,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c8338fd >2013-12-09 12:08:05,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1407ff9a >2013-12-09 12:08:05,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1407ff9a >2013-12-09 12:08:05,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33efcc9a >2013-12-09 12:08:05,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33efcc9a >2013-12-09 12:08:10,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55db7708 >2013-12-09 12:08:11,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 55db7708 >2013-12-09 12:08:11,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b33f482 >2013-12-09 12:08:11,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b33f482 >2013-12-09 12:08:16,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48b92c72 >2013-12-09 12:08:17,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 48b92c72 >2013-12-09 12:08:17,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37d050ff >2013-12-09 12:08:17,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37d050ff >2013-12-09 12:08:22,292 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-16) No up server in cluster >2013-12-09 12:08:22,292 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-16) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:08:22,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 60dc37a0 >2013-12-09 12:08:22,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 272328fe >2013-12-09 12:08:22,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterTasksListVDSCommand, return: [], log id: 60dc37a0 >2013-12-09 12:08:22,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 272328fe >2013-12-09 12:08:22,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ab0171d >2013-12-09 12:08:23,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ab0171d >2013-12-09 12:08:28,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7cd8f5a2 >2013-12-09 12:08:28,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7cd8f5a2 >2013-12-09 12:08:28,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f921844 >2013-12-09 12:08:28,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f921844 >2013-12-09 12:08:33,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ca6127f >2013-12-09 12:08:34,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2ca6127f >2013-12-09 12:08:34,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 44f0cbb5 >2013-12-09 12:08:34,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44f0cbb5 >2013-12-09 12:08:39,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35866a72 >2013-12-09 12:08:40,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 35866a72 >2013-12-09 12:08:40,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 14275945 >2013-12-09 12:08:40,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14275945 >2013-12-09 12:08:45,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a24cfd3 >2013-12-09 12:08:46,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2a24cfd3 >2013-12-09 12:08:46,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11431931 >2013-12-09 12:08:46,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11431931 >2013-12-09 12:08:51,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a03381f >2013-12-09 12:08:51,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3a03381f >2013-12-09 12:08:51,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3bd054c3 >2013-12-09 12:08:52,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3bd054c3 >2013-12-09 12:08:57,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e53b92e >2013-12-09 12:08:57,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7e53b92e >2013-12-09 12:08:57,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 337db1a5 >2013-12-09 12:08:57,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 337db1a5 >2013-12-09 12:09:02,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2768c688 >2013-12-09 12:09:03,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2768c688 >2013-12-09 12:09:03,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 993bf0c >2013-12-09 12:09:03,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 993bf0c >2013-12-09 12:09:08,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75f95db6 >2013-12-09 12:09:09,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 75f95db6 >2013-12-09 12:09:09,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72550854 >2013-12-09 12:09:09,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72550854 >2013-12-09 12:09:14,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8eb197f >2013-12-09 12:09:15,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 8eb197f >2013-12-09 12:09:15,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 399178ca >2013-12-09 12:09:15,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 399178ca >2013-12-09 12:09:20,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c648f58 >2013-12-09 12:09:20,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7c648f58 >2013-12-09 12:09:20,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: dc3e17c >2013-12-09 12:09:21,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: dc3e17c >2013-12-09 12:09:22,559 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-21) No up server in cluster >2013-12-09 12:09:22,559 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-21) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:09:22,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d827e7b >2013-12-09 12:09:22,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3d827e7b >2013-12-09 12:09:26,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3488c1ae >2013-12-09 12:09:26,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3488c1ae >2013-12-09 12:09:26,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16bb6e62 >2013-12-09 12:09:26,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16bb6e62 >2013-12-09 12:09:31,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47f55044 >2013-12-09 12:09:32,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 47f55044 >2013-12-09 12:09:32,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44dc79cd >2013-12-09 12:09:32,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44dc79cd >2013-12-09 12:09:37,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63a13156 >2013-12-09 12:09:38,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 63a13156 >2013-12-09 12:09:38,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e78b49c >2013-12-09 12:09:38,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e78b49c >2013-12-09 12:09:43,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40c1fff1 >2013-12-09 12:09:43,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 40c1fff1 >2013-12-09 12:09:43,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c45162c >2013-12-09 12:09:44,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c45162c >2013-12-09 12:09:49,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 787119bc >2013-12-09 12:09:49,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 787119bc >2013-12-09 12:09:49,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15ad8b9b >2013-12-09 12:09:49,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15ad8b9b >2013-12-09 12:09:54,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6dc9da5e >2013-12-09 12:09:55,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6dc9da5e >2013-12-09 12:09:55,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1731638b >2013-12-09 12:09:55,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1731638b >2013-12-09 12:10:00,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d09498 >2013-12-09 12:10:01,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d09498 >2013-12-09 12:10:01,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44ffdf3c >2013-12-09 12:10:01,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44ffdf3c >2013-12-09 12:10:06,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3dcc9170 >2013-12-09 12:10:07,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3dcc9170 >2013-12-09 12:10:07,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e50de14 >2013-12-09 12:10:07,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e50de14 >2013-12-09 12:10:12,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3538608 >2013-12-09 12:10:12,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3538608 >2013-12-09 12:10:12,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34c57289 >2013-12-09 12:10:13,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34c57289 >2013-12-09 12:10:18,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7aafac3e >2013-12-09 12:10:18,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7aafac3e >2013-12-09 12:10:18,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29f67f7a >2013-12-09 12:10:18,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29f67f7a >2013-12-09 12:10:22,845 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-20) No up server in cluster >2013-12-09 12:10:22,845 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-20) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:10:22,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d39cf2 >2013-12-09 12:10:23,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1d39cf2 >2013-12-09 12:10:23,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 24fb36e8 >2013-12-09 12:10:24,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 24fb36e8 >2013-12-09 12:10:24,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3791ab6 >2013-12-09 12:10:24,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3791ab6 >2013-12-09 12:10:29,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21e64104 >2013-12-09 12:10:30,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 21e64104 >2013-12-09 12:10:30,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d851ecc >2013-12-09 12:10:30,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d851ecc >2013-12-09 12:10:35,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25b179be >2013-12-09 12:10:35,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 25b179be >2013-12-09 12:10:35,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f3be1fd >2013-12-09 12:10:36,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f3be1fd >2013-12-09 12:10:41,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4759be3b >2013-12-09 12:10:41,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4759be3b >2013-12-09 12:10:41,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a73fffb >2013-12-09 12:10:41,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a73fffb >2013-12-09 12:10:46,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a9bb1aa >2013-12-09 12:10:47,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1a9bb1aa >2013-12-09 12:10:47,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f61efae >2013-12-09 12:10:47,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f61efae >2013-12-09 12:10:52,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63b43fca >2013-12-09 12:10:53,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 63b43fca >2013-12-09 12:10:53,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c5a8fa0 >2013-12-09 12:10:53,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c5a8fa0 >2013-12-09 12:10:58,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35bad6ce >2013-12-09 12:10:59,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 35bad6ce >2013-12-09 12:10:59,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c04f929 >2013-12-09 12:10:59,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c04f929 >2013-12-09 12:11:04,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1355e2ad >2013-12-09 12:11:04,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1355e2ad >2013-12-09 12:11:04,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d5e3aff >2013-12-09 12:11:05,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d5e3aff >2013-12-09 12:11:10,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d7ba46 >2013-12-09 12:11:10,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6d7ba46 >2013-12-09 12:11:10,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 530972dc >2013-12-09 12:11:10,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 530972dc >2013-12-09 12:11:15,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56179b8c >2013-12-09 12:11:16,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 56179b8c >2013-12-09 12:11:16,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4db03cdc >2013-12-09 12:11:16,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4db03cdc >2013-12-09 12:11:21,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fb5f8cd >2013-12-09 12:11:22,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2fb5f8cd >2013-12-09 12:11:22,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64e1780 >2013-12-09 12:11:22,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64e1780 >2013-12-09 12:11:23,129 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-1) No up server in cluster >2013-12-09 12:11:23,130 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-1) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:11:23,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b2f5238 >2013-12-09 12:11:23,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7b2f5238 >2013-12-09 12:11:27,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43401612 >2013-12-09 12:11:27,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 43401612 >2013-12-09 12:11:27,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29a7ace2 >2013-12-09 12:11:28,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29a7ace2 >2013-12-09 12:11:33,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51c8b300 >2013-12-09 12:11:33,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 51c8b300 >2013-12-09 12:11:33,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 349b394f >2013-12-09 12:11:33,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 349b394f >2013-12-09 12:11:39,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f289383 >2013-12-09 12:11:39,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6f289383 >2013-12-09 12:11:39,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e549344 >2013-12-09 12:11:39,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e549344 >2013-12-09 12:11:44,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7592532e >2013-12-09 12:11:45,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7592532e >2013-12-09 12:11:45,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b476364 >2013-12-09 12:11:45,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b476364 >2013-12-09 12:11:50,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c57d17f >2013-12-09 12:11:51,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c57d17f >2013-12-09 12:11:51,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c72f682 >2013-12-09 12:11:51,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c72f682 >2013-12-09 12:11:56,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72a76849 >2013-12-09 12:11:56,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 72a76849 >2013-12-09 12:11:56,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35ad8d46 >2013-12-09 12:11:57,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35ad8d46 >2013-12-09 12:12:02,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a23956f >2013-12-09 12:12:02,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6a23956f >2013-12-09 12:12:02,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e4a9e86 >2013-12-09 12:12:02,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e4a9e86 >2013-12-09 12:12:07,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6dc22510 >2013-12-09 12:12:08,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6dc22510 >2013-12-09 12:12:08,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20d088b5 >2013-12-09 12:12:08,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20d088b5 >2013-12-09 12:12:13,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38b7b92d >2013-12-09 12:12:14,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 38b7b92d >2013-12-09 12:12:14,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2efee1fe >2013-12-09 12:12:14,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2efee1fe >2013-12-09 12:12:19,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: bb8b76d >2013-12-09 12:12:19,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: bb8b76d >2013-12-09 12:12:19,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f77a0fd >2013-12-09 12:12:20,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f77a0fd >2013-12-09 12:12:23,407 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-73) No up server in cluster >2013-12-09 12:12:23,407 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-73) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:12:23,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b4f7b5a >2013-12-09 12:12:23,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4b4f7b5a >2013-12-09 12:12:25,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 512ea33d >2013-12-09 12:12:25,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 512ea33d >2013-12-09 12:12:25,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e0f76b8 >2013-12-09 12:12:25,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e0f76b8 >2013-12-09 12:12:31,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11f0f6aa >2013-12-09 12:12:31,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 11f0f6aa >2013-12-09 12:12:31,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4501dbca >2013-12-09 12:12:31,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4501dbca >2013-12-09 12:12:36,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f1282dd >2013-12-09 12:12:37,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5f1282dd >2013-12-09 12:12:37,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c0dd90c >2013-12-09 12:12:37,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c0dd90c >2013-12-09 12:12:42,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3cd02ba3 >2013-12-09 12:12:43,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3cd02ba3 >2013-12-09 12:12:43,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6fa8ef56 >2013-12-09 12:12:43,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6fa8ef56 >2013-12-09 12:12:48,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45eaa66a >2013-12-09 12:12:48,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 45eaa66a >2013-12-09 12:12:48,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 556f7397 >2013-12-09 12:12:49,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 556f7397 >2013-12-09 12:12:54,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 404d704b >2013-12-09 12:12:54,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 404d704b >2013-12-09 12:12:54,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 765cb272 >2013-12-09 12:12:55,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 765cb272 >2013-12-09 12:13:00,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36ce402f >2013-12-09 12:13:00,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 36ce402f >2013-12-09 12:13:00,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1dae7586 >2013-12-09 12:13:00,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1dae7586 >2013-12-09 12:13:05,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1edf084c >2013-12-09 12:13:06,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1edf084c >2013-12-09 12:13:06,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ad55e44 >2013-12-09 12:13:06,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ad55e44 >2013-12-09 12:13:11,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24d4b1cf >2013-12-09 12:13:12,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 24d4b1cf >2013-12-09 12:13:12,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ac9a652 >2013-12-09 12:13:12,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ac9a652 >2013-12-09 12:13:17,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f2e44fd >2013-12-09 12:13:17,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5f2e44fd >2013-12-09 12:13:17,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f280ae6 >2013-12-09 12:13:18,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f280ae6 >2013-12-09 12:13:23,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b0858ed >2013-12-09 12:13:23,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: b0858ed >2013-12-09 12:13:23,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48191ec0 >2013-12-09 12:13:23,698 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-34) No up server in cluster >2013-12-09 12:13:23,698 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-34) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:13:23,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 198f8b2a >2013-12-09 12:13:23,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48191ec0 >2013-12-09 12:13:23,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterTasksListVDSCommand, return: [], log id: 198f8b2a >2013-12-09 12:13:28,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53d078cf >2013-12-09 12:13:29,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 53d078cf >2013-12-09 12:13:29,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71cf5430 >2013-12-09 12:13:29,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71cf5430 >2013-12-09 12:13:34,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a9a85c >2013-12-09 12:13:35,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: a9a85c >2013-12-09 12:13:35,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c978519 >2013-12-09 12:13:35,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c978519 >2013-12-09 12:13:40,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 292038eb >2013-12-09 12:13:41,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 292038eb >2013-12-09 12:13:41,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39917244 >2013-12-09 12:13:41,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39917244 >2013-12-09 12:13:46,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b64a426 >2013-12-09 12:13:46,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: b64a426 >2013-12-09 12:13:46,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5cd4215d >2013-12-09 12:13:47,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cd4215d >2013-12-09 12:13:52,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b5672ce >2013-12-09 12:13:52,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b5672ce >2013-12-09 12:13:52,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5517a910 >2013-12-09 12:13:52,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5517a910 >2013-12-09 12:13:57,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5896c393 >2013-12-09 12:13:58,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5896c393 >2013-12-09 12:13:58,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7260cd2e >2013-12-09 12:13:58,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7260cd2e >2013-12-09 12:14:03,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 487c9a2f >2013-12-09 12:14:04,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 487c9a2f >2013-12-09 12:14:04,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 22bfd590 >2013-12-09 12:14:04,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22bfd590 >2013-12-09 12:14:09,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 474f57d1 >2013-12-09 12:14:09,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 474f57d1 >2013-12-09 12:14:09,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50aeb232 >2013-12-09 12:14:10,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50aeb232 >2013-12-09 12:14:15,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 302d9576 >2013-12-09 12:14:15,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 302d9576 >2013-12-09 12:14:15,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 630a5a1 >2013-12-09 12:14:16,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 630a5a1 >2013-12-09 12:14:21,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7dce22da >2013-12-09 12:14:21,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7dce22da >2013-12-09 12:14:21,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ecabc50 >2013-12-09 12:14:21,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ecabc50 >2013-12-09 12:14:23,973 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-47) No up server in cluster >2013-12-09 12:14:23,973 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-47) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:14:23,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12da28ae >2013-12-09 12:14:24,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterTasksListVDSCommand, return: [], log id: 12da28ae >2013-12-09 12:14:26,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f0414b9 >2013-12-09 12:14:27,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f0414b9 >2013-12-09 12:14:27,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 538475c0 >2013-12-09 12:14:27,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 538475c0 >2013-12-09 12:14:32,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38e28d6 >2013-12-09 12:14:33,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 38e28d6 >2013-12-09 12:14:33,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a5ee5f4 >2013-12-09 12:14:33,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a5ee5f4 >2013-12-09 12:14:38,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 470cad9a >2013-12-09 12:14:38,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 470cad9a >2013-12-09 12:14:38,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19c3502d >2013-12-09 12:14:39,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19c3502d >2013-12-09 12:14:44,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77e082c5 >2013-12-09 12:14:44,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 77e082c5 >2013-12-09 12:14:44,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59d2be83 >2013-12-09 12:14:44,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59d2be83 >2013-12-09 12:14:49,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f81847c >2013-12-09 12:14:50,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: f81847c >2013-12-09 12:14:50,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41f510ee >2013-12-09 12:14:50,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41f510ee >2013-12-09 12:14:55,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36dce669 >2013-12-09 12:14:56,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 36dce669 >2013-12-09 12:14:56,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11969caa >2013-12-09 12:14:56,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11969caa >2013-12-09 12:15:01,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f63f801 >2013-12-09 12:15:01,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f63f801 >2013-12-09 12:15:01,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50b348b2 >2013-12-09 12:15:02,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50b348b2 >2013-12-09 12:15:07,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48b8d84 >2013-12-09 12:15:07,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 48b8d84 >2013-12-09 12:15:07,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 14ff3139 >2013-12-09 12:15:08,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14ff3139 >2013-12-09 12:15:13,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26c62e52 >2013-12-09 12:15:13,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 26c62e52 >2013-12-09 12:15:13,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7483b349 >2013-12-09 12:15:13,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7483b349 >2013-12-09 12:15:18,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f287efe >2013-12-09 12:15:19,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: f287efe >2013-12-09 12:15:19,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57465b4f >2013-12-09 12:15:19,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57465b4f >2013-12-09 12:15:24,251 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-83) No up server in cluster >2013-12-09 12:15:24,251 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-83) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:15:24,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a971713 >2013-12-09 12:15:24,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6a971713 >2013-12-09 12:15:24,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18ab0730 >2013-12-09 12:15:25,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 18ab0730 >2013-12-09 12:15:25,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 296dce >2013-12-09 12:15:25,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 296dce >2013-12-09 12:15:30,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73f4764b >2013-12-09 12:15:30,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 73f4764b >2013-12-09 12:15:30,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43ce9ba6 >2013-12-09 12:15:31,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43ce9ba6 >2013-12-09 12:15:36,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 677b7caa >2013-12-09 12:15:36,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 677b7caa >2013-12-09 12:15:36,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71e43f82 >2013-12-09 12:15:36,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71e43f82 >2013-12-09 12:15:41,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2752bb8e >2013-12-09 12:15:42,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2752bb8e >2013-12-09 12:15:42,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c89ef66 >2013-12-09 12:15:42,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c89ef66 >2013-12-09 12:15:47,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12079f5e >2013-12-09 12:15:48,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 12079f5e >2013-12-09 12:15:48,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45812f88 >2013-12-09 12:15:48,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45812f88 >2013-12-09 12:15:53,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ab6931d >2013-12-09 12:15:54,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5ab6931d >2013-12-09 12:15:54,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3194ad77 >2013-12-09 12:15:54,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3194ad77 >2013-12-09 12:15:59,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6278fd3f >2013-12-09 12:15:59,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6278fd3f >2013-12-09 12:15:59,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63bfd1b7 >2013-12-09 12:16:00,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63bfd1b7 >2013-12-09 12:16:05,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 169bc4f7 >2013-12-09 12:16:05,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 169bc4f7 >2013-12-09 12:16:05,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 378d84a4 >2013-12-09 12:16:05,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 378d84a4 >2013-12-09 12:16:10,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7702c66d >2013-12-09 12:16:11,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7702c66d >2013-12-09 12:16:11,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f0076d1 >2013-12-09 12:16:11,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f0076d1 >2013-12-09 12:16:16,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24a7fe4e >2013-12-09 12:16:17,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 24a7fe4e >2013-12-09 12:16:17,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79c1c1e9 >2013-12-09 12:16:17,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79c1c1e9 >2013-12-09 12:16:22,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4dd20c95 >2013-12-09 12:16:22,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4dd20c95 >2013-12-09 12:16:22,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73b4dedf >2013-12-09 12:16:23,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73b4dedf >2013-12-09 12:16:24,548 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-89) No up server in cluster >2013-12-09 12:16:24,548 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-89) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:16:24,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e8e727 >2013-12-09 12:16:24,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5e8e727 >2013-12-09 12:16:28,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fdd9340 >2013-12-09 12:16:28,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2fdd9340 >2013-12-09 12:16:28,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1daf9ea6 >2013-12-09 12:16:28,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1daf9ea6 >2013-12-09 12:16:33,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 613d5944 >2013-12-09 12:16:34,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 613d5944 >2013-12-09 12:16:34,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b4c8c50 >2013-12-09 12:16:34,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b4c8c50 >2013-12-09 12:16:39,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 364ccbdb >2013-12-09 12:16:40,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 364ccbdb >2013-12-09 12:16:40,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24c9eaeb >2013-12-09 12:16:40,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24c9eaeb >2013-12-09 12:16:45,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 847c466 >2013-12-09 12:16:46,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 847c466 >2013-12-09 12:16:46,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b74928 >2013-12-09 12:16:46,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b74928 >2013-12-09 12:16:51,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52184442 >2013-12-09 12:16:51,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 52184442 >2013-12-09 12:16:51,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47615129 >2013-12-09 12:16:52,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47615129 >2013-12-09 12:16:57,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6dab7655 >2013-12-09 12:16:57,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6dab7655 >2013-12-09 12:16:57,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6261daf3 >2013-12-09 12:16:57,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6261daf3 >2013-12-09 12:17:02,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12231cbf >2013-12-09 12:17:03,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 12231cbf >2013-12-09 12:17:03,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 455283c5 >2013-12-09 12:17:03,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 455283c5 >2013-12-09 12:17:08,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35d45f56 >2013-12-09 12:17:09,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 35d45f56 >2013-12-09 12:17:09,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41c66f69 >2013-12-09 12:17:09,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41c66f69 >2013-12-09 12:17:14,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18972a5d >2013-12-09 12:17:14,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 18972a5d >2013-12-09 12:17:14,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18542b >2013-12-09 12:17:15,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18542b >2013-12-09 12:17:20,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11c032a4 >2013-12-09 12:17:20,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 11c032a4 >2013-12-09 12:17:20,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66c24fc4 >2013-12-09 12:17:20,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66c24fc4 >2013-12-09 12:17:24,816 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-45) No up server in cluster >2013-12-09 12:17:24,816 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-45) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:17:24,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d662c47 >2013-12-09 12:17:25,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5d662c47 >2013-12-09 12:17:25,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5838d6f1 >2013-12-09 12:17:26,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5838d6f1 >2013-12-09 12:17:26,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f556343 >2013-12-09 12:17:26,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f556343 >2013-12-09 12:17:31,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3355abe5 >2013-12-09 12:17:32,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3355abe5 >2013-12-09 12:17:32,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 923b52e >2013-12-09 12:17:32,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 923b52e >2013-12-09 12:17:37,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 715b9ffe >2013-12-09 12:17:38,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 715b9ffe >2013-12-09 12:17:38,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7346989d >2013-12-09 12:17:38,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7346989d >2013-12-09 12:17:43,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c2bb316 >2013-12-09 12:17:43,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7c2bb316 >2013-12-09 12:17:43,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f97a000 >2013-12-09 12:17:44,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f97a000 >2013-12-09 12:17:49,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f05408a >2013-12-09 12:17:49,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f05408a >2013-12-09 12:17:49,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5fc3b5f8 >2013-12-09 12:17:49,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fc3b5f8 >2013-12-09 12:17:54,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3492aafc >2013-12-09 12:17:55,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3492aafc >2013-12-09 12:17:55,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4339360c >2013-12-09 12:17:55,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4339360c >2013-12-09 12:18:00,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6de6e198 >2013-12-09 12:18:01,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6de6e198 >2013-12-09 12:18:01,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e11b3f6 >2013-12-09 12:18:01,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e11b3f6 >2013-12-09 12:18:06,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4faea0c7 >2013-12-09 12:18:06,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4faea0c7 >2013-12-09 12:18:06,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7cffebbf >2013-12-09 12:18:07,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7cffebbf >2013-12-09 12:18:12,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16bcebef >2013-12-09 12:18:12,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 16bcebef >2013-12-09 12:18:12,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ddf790d >2013-12-09 12:18:13,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ddf790d >2013-12-09 12:18:18,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b022ca0 >2013-12-09 12:18:18,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: b022ca0 >2013-12-09 12:18:18,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59240cc4 >2013-12-09 12:18:18,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59240cc4 >2013-12-09 12:18:23,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39a47210 >2013-12-09 12:18:24,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 39a47210 >2013-12-09 12:18:24,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31de0321 >2013-12-09 12:18:24,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31de0321 >2013-12-09 12:18:25,105 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-8) No up server in cluster >2013-12-09 12:18:25,105 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-8) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:18:25,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 720c1259 >2013-12-09 12:18:25,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterTasksListVDSCommand, return: [], log id: 720c1259 >2013-12-09 12:18:29,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11eb52dd >2013-12-09 12:18:30,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 11eb52dd >2013-12-09 12:18:30,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 225ef6db >2013-12-09 12:18:30,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 225ef6db >2013-12-09 12:18:35,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d56d5b9 >2013-12-09 12:18:35,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: d56d5b9 >2013-12-09 12:18:35,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5470ff0b >2013-12-09 12:18:36,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5470ff0b >2013-12-09 12:18:41,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e1e4414 >2013-12-09 12:18:41,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e1e4414 >2013-12-09 12:18:41,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29ff06b6 >2013-12-09 12:18:41,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29ff06b6 >2013-12-09 12:18:46,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ad87c5e >2013-12-09 12:18:47,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5ad87c5e >2013-12-09 12:18:47,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74644738 >2013-12-09 12:18:47,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74644738 >2013-12-09 12:18:52,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58c540d1 >2013-12-09 12:18:53,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 58c540d1 >2013-12-09 12:18:53,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a1f0a27 >2013-12-09 12:18:53,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a1f0a27 >2013-12-09 12:18:58,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ee8c4dd >2013-12-09 12:18:58,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ee8c4dd >2013-12-09 12:18:58,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 648eacc4 >2013-12-09 12:18:59,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 648eacc4 >2013-12-09 12:19:04,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19b3a323 >2013-12-09 12:19:04,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19b3a323 >2013-12-09 12:19:04,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69068e37 >2013-12-09 12:19:04,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69068e37 >2013-12-09 12:19:09,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14200de8 >2013-12-09 12:19:10,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 14200de8 >2013-12-09 12:19:10,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63cbf08b >2013-12-09 12:19:10,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63cbf08b >2013-12-09 12:19:15,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 689b6f0d >2013-12-09 12:19:16,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 689b6f0d >2013-12-09 12:19:16,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 759726d1 >2013-12-09 12:19:16,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 759726d1 >2013-12-09 12:19:21,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6cd448a1 >2013-12-09 12:19:22,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6cd448a1 >2013-12-09 12:19:22,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50d92b98 >2013-12-09 12:19:22,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50d92b98 >2013-12-09 12:19:25,388 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-59) No up server in cluster >2013-12-09 12:19:25,388 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-59) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:19:25,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26663718 >2013-12-09 12:19:25,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterTasksListVDSCommand, return: [], log id: 26663718 >2013-12-09 12:19:27,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d17ea81 >2013-12-09 12:19:27,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d17ea81 >2013-12-09 12:19:27,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3791e0cf >2013-12-09 12:19:28,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3791e0cf >2013-12-09 12:19:33,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f0acc4f >2013-12-09 12:19:33,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f0acc4f >2013-12-09 12:19:33,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32447c62 >2013-12-09 12:19:33,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32447c62 >2013-12-09 12:19:38,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32562c7b >2013-12-09 12:19:39,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 32562c7b >2013-12-09 12:19:39,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56c3f001 >2013-12-09 12:19:39,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56c3f001 >2013-12-09 12:19:44,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2332700e >2013-12-09 12:19:45,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2332700e >2013-12-09 12:19:45,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a83c6c9 >2013-12-09 12:19:45,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a83c6c9 >2013-12-09 12:19:50,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72140f44 >2013-12-09 12:19:50,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 72140f44 >2013-12-09 12:19:50,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52e6bb83 >2013-12-09 12:19:51,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52e6bb83 >2013-12-09 12:19:56,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5aab0fa >2013-12-09 12:19:56,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5aab0fa >2013-12-09 12:19:56,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 632f30d6 >2013-12-09 12:19:57,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 632f30d6 >2013-12-09 12:20:02,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 351648b8 >2013-12-09 12:20:02,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 351648b8 >2013-12-09 12:20:02,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20557d49 >2013-12-09 12:20:02,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20557d49 >2013-12-09 12:20:07,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65a3d3df >2013-12-09 12:20:08,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 65a3d3df >2013-12-09 12:20:08,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3cf61f2b >2013-12-09 12:20:08,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3cf61f2b >2013-12-09 12:20:13,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b85283f >2013-12-09 12:20:14,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b85283f >2013-12-09 12:20:14,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23a0a783 >2013-12-09 12:20:14,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23a0a783 >2013-12-09 12:20:19,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e130cc3 >2013-12-09 12:20:19,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e130cc3 >2013-12-09 12:20:19,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41c82416 >2013-12-09 12:20:20,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41c82416 >2013-12-09 12:20:25,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73a2e15e >2013-12-09 12:20:25,678 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-24) No up server in cluster >2013-12-09 12:20:25,678 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-24) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:20:25,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 601e59d6 >2013-12-09 12:20:25,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 73a2e15e >2013-12-09 12:20:25,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4377bf01 >2013-12-09 12:20:25,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterTasksListVDSCommand, return: [], log id: 601e59d6 >2013-12-09 12:20:25,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4377bf01 >2013-12-09 12:20:30,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 280a5a16 >2013-12-09 12:20:31,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 280a5a16 >2013-12-09 12:20:31,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 441b67e3 >2013-12-09 12:20:31,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 441b67e3 >2013-12-09 12:20:36,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2390d034 >2013-12-09 12:20:37,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2390d034 >2013-12-09 12:20:37,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c95cb0a >2013-12-09 12:20:37,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c95cb0a >2013-12-09 12:20:42,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61779a6a >2013-12-09 12:20:43,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 61779a6a >2013-12-09 12:20:43,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c3d0de >2013-12-09 12:20:43,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c3d0de >2013-12-09 12:20:48,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 769b98e2 >2013-12-09 12:20:48,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 769b98e2 >2013-12-09 12:20:48,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8d52775 >2013-12-09 12:20:49,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8d52775 >2013-12-09 12:20:54,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 587d8b04 >2013-12-09 12:20:54,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 587d8b04 >2013-12-09 12:20:54,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ebcb4a4 >2013-12-09 12:20:54,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ebcb4a4 >2013-12-09 12:20:59,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7db458db >2013-12-09 12:21:00,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7db458db >2013-12-09 12:21:00,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2641853a >2013-12-09 12:21:00,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2641853a >2013-12-09 12:21:05,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26dbe474 >2013-12-09 12:21:06,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 26dbe474 >2013-12-09 12:21:06,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a57c053 >2013-12-09 12:21:06,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a57c053 >2013-12-09 12:21:11,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7acc6955 >2013-12-09 12:21:11,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7acc6955 >2013-12-09 12:21:12,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 115c6686 >2013-12-09 12:21:12,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 115c6686 >2013-12-09 12:21:17,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24a58b5a >2013-12-09 12:21:17,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 24a58b5a >2013-12-09 12:21:17,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59e12ef5 >2013-12-09 12:21:18,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59e12ef5 >2013-12-09 12:21:23,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12e7aaf9 >2013-12-09 12:21:23,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 12e7aaf9 >2013-12-09 12:21:23,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2689eb4e >2013-12-09 12:21:23,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2689eb4e >2013-12-09 12:21:25,966 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) No up server in cluster >2013-12-09 12:21:25,967 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:21:25,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d104c0 >2013-12-09 12:21:26,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7d104c0 >2013-12-09 12:21:28,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79d99575 >2013-12-09 12:21:29,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 79d99575 >2013-12-09 12:21:29,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20a03404 >2013-12-09 12:21:29,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20a03404 >2013-12-09 12:21:34,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b766bf6 >2013-12-09 12:21:35,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b766bf6 >2013-12-09 12:21:35,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 777a9b16 >2013-12-09 12:21:35,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 777a9b16 >2013-12-09 12:21:40,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c35defd >2013-12-09 12:21:40,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: c35defd >2013-12-09 12:21:40,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a8a16c0 >2013-12-09 12:21:41,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a8a16c0 >2013-12-09 12:21:46,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59b86883 >2013-12-09 12:21:46,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59b86883 >2013-12-09 12:21:46,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ae1e3db >2013-12-09 12:21:46,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ae1e3db >2013-12-09 12:21:49,391 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-9) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-09 12:21:50,092 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-5) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-09 12:21:51,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 332cc44c >2013-12-09 12:21:52,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 332cc44c >2013-12-09 12:21:52,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c0d6c6e >2013-12-09 12:21:52,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c0d6c6e >2013-12-09 12:21:56,486 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-12) Running command: LoginAdminUserCommand internal: false. >2013-12-09 12:21:56,499 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-12) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2013-12-09 12:21:56,585 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-12) Running command: LoginUserCommand internal: false. >2013-12-09 12:21:56,591 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-12) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2013-12-09 12:21:57,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d2a6489 >2013-12-09 12:21:58,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d2a6489 >2013-12-09 12:21:58,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4043cc63 >2013-12-09 12:21:58,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4043cc63 >2013-12-09 12:22:01,346 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-15) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-09 12:22:03,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b7c57af >2013-12-09 12:22:04,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3b7c57af >2013-12-09 12:22:04,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2622b13e >2013-12-09 12:22:04,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2622b13e >2013-12-09 12:22:08,894 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-3) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-09 12:22:08,924 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-15) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-09 12:22:09,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19294d48 >2013-12-09 12:22:09,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 19294d48 >2013-12-09 12:22:09,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2215d307 >2013-12-09 12:22:10,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2215d307 >2013-12-09 12:22:15,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7293742b >2013-12-09 12:22:15,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7293742b >2013-12-09 12:22:15,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 247044e1 >2013-12-09 12:22:15,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 247044e1 >2013-12-09 12:22:20,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64850836 >2013-12-09 12:22:21,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 64850836 >2013-12-09 12:22:21,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ab0cbb4 >2013-12-09 12:22:21,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ab0cbb4 >2013-12-09 12:22:26,257 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-26) No up server in cluster >2013-12-09 12:22:26,257 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-26) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:22:26,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68e3c156 >2013-12-09 12:22:26,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterTasksListVDSCommand, return: [], log id: 68e3c156 >2013-12-09 12:22:26,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70925637 >2013-12-09 12:22:27,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 70925637 >2013-12-09 12:22:27,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d2ec711 >2013-12-09 12:22:27,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d2ec711 >2013-12-09 12:22:32,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77f2323f >2013-12-09 12:22:32,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 77f2323f >2013-12-09 12:22:32,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 461af602 >2013-12-09 12:22:33,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 461af602 >2013-12-09 12:22:38,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 478c0a9a >2013-12-09 12:22:38,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 478c0a9a >2013-12-09 12:22:38,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58d17802 >2013-12-09 12:22:38,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58d17802 >2013-12-09 12:22:43,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1438159c >2013-12-09 12:22:44,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1438159c >2013-12-09 12:22:44,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35969047 >2013-12-09 12:22:44,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35969047 >2013-12-09 12:22:49,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33f14181 >2013-12-09 12:22:50,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 33f14181 >2013-12-09 12:22:50,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62b8e6f1 >2013-12-09 12:22:50,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62b8e6f1 >2013-12-09 12:22:55,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d4b7c87 >2013-12-09 12:22:56,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d4b7c87 >2013-12-09 12:22:56,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a3f4b4e >2013-12-09 12:22:56,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a3f4b4e >2013-12-09 12:23:01,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e9d1585 >2013-12-09 12:23:01,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2e9d1585 >2013-12-09 12:23:01,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ded8569 >2013-12-09 12:23:02,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ded8569 >2013-12-09 12:23:07,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39f5eb43 >2013-12-09 12:23:07,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 39f5eb43 >2013-12-09 12:23:07,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ce5bb65 >2013-12-09 12:23:07,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ce5bb65 >2013-12-09 12:23:12,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5347562 >2013-12-09 12:23:13,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5347562 >2013-12-09 12:23:13,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45de4fab >2013-12-09 12:23:13,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45de4fab >2013-12-09 12:23:18,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3bff8985 >2013-12-09 12:23:19,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3bff8985 >2013-12-09 12:23:19,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e4ae447 >2013-12-09 12:23:19,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e4ae447 >2013-12-09 12:23:24,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45383d >2013-12-09 12:23:25,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 45383d >2013-12-09 12:23:25,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c079154 >2013-12-09 12:23:25,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c079154 >2013-12-09 12:23:26,537 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-57) No up server in cluster >2013-12-09 12:23:26,537 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-57) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:23:26,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c42b360 >2013-12-09 12:23:26,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7c42b360 >2013-12-09 12:23:30,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64be452b >2013-12-09 12:23:30,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 64be452b >2013-12-09 12:23:30,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71057568 >2013-12-09 12:23:31,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71057568 >2013-12-09 12:23:36,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2261b55d >2013-12-09 12:23:36,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2261b55d >2013-12-09 12:23:36,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68efe5ed >2013-12-09 12:23:36,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68efe5ed >2013-12-09 12:23:41,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 599a0cd4 >2013-12-09 12:23:42,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 599a0cd4 >2013-12-09 12:23:42,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 673f936e >2013-12-09 12:23:42,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 673f936e >2013-12-09 12:23:47,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 148d87df >2013-12-09 12:23:48,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 148d87df >2013-12-09 12:23:48,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3912f45 >2013-12-09 12:23:48,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3912f45 >2013-12-09 12:23:53,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 154b6d9d >2013-12-09 12:23:53,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 154b6d9d >2013-12-09 12:23:53,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30f7c5c6 >2013-12-09 12:23:54,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30f7c5c6 >2013-12-09 12:23:59,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 105bd3b4 >2013-12-09 12:23:59,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 105bd3b4 >2013-12-09 12:23:59,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3587d229 >2013-12-09 12:23:59,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3587d229 >2013-12-09 12:24:05,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34034160 >2013-12-09 12:24:05,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 34034160 >2013-12-09 12:24:05,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5230555e >2013-12-09 12:24:05,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5230555e >2013-12-09 12:24:10,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 733415fe >2013-12-09 12:24:11,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 733415fe >2013-12-09 12:24:11,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3530f2b2 >2013-12-09 12:24:11,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3530f2b2 >2013-12-09 12:24:16,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 384dee61 >2013-12-09 12:24:17,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 384dee61 >2013-12-09 12:24:17,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2137bfe3 >2013-12-09 12:24:17,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2137bfe3 >2013-12-09 12:24:22,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 108dea5f >2013-12-09 12:24:22,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 108dea5f >2013-12-09 12:24:22,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: fae20da >2013-12-09 12:24:23,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: fae20da >2013-12-09 12:24:26,816 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-34) No up server in cluster >2013-12-09 12:24:26,817 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-34) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:24:26,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41a5a467 >2013-12-09 12:24:27,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterTasksListVDSCommand, return: [], log id: 41a5a467 >2013-12-09 12:24:28,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6db27399 >2013-12-09 12:24:28,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6db27399 >2013-12-09 12:24:28,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d7484f4 >2013-12-09 12:24:28,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d7484f4 >2013-12-09 12:24:33,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3181ac9f >2013-12-09 12:24:34,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3181ac9f >2013-12-09 12:24:34,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17d5661e >2013-12-09 12:24:34,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17d5661e >2013-12-09 12:24:39,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2abd98b3 >2013-12-09 12:24:40,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2abd98b3 >2013-12-09 12:24:40,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 108c229 >2013-12-09 12:24:40,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 108c229 >2013-12-09 12:24:45,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: fb3f1a >2013-12-09 12:24:45,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: fb3f1a >2013-12-09 12:24:45,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c21396d >2013-12-09 12:24:46,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c21396d >2013-12-09 12:24:51,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e6d76b6 >2013-12-09 12:24:51,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e6d76b6 >2013-12-09 12:24:51,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5aa1c30a >2013-12-09 12:24:51,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5aa1c30a >2013-12-09 12:24:57,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e1d22af >2013-12-09 12:24:57,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e1d22af >2013-12-09 12:24:57,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d4f2710 >2013-12-09 12:24:57,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d4f2710 >2013-12-09 12:25:02,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52369855 >2013-12-09 12:25:03,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 52369855 >2013-12-09 12:25:03,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19c34637 >2013-12-09 12:25:03,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19c34637 >2013-12-09 12:25:08,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 316b5fdb >2013-12-09 12:25:09,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 316b5fdb >2013-12-09 12:25:09,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e486738 >2013-12-09 12:25:09,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e486738 >2013-12-09 12:25:14,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2431ee84 >2013-12-09 12:25:14,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2431ee84 >2013-12-09 12:25:14,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45d57372 >2013-12-09 12:25:15,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45d57372 >2013-12-09 12:25:20,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3da5a55d >2013-12-09 12:25:20,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3da5a55d >2013-12-09 12:25:20,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4912b0c3 >2013-12-09 12:25:20,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4912b0c3 >2013-12-09 12:25:25,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 632afbd5 >2013-12-09 12:25:26,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 632afbd5 >2013-12-09 12:25:26,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34021b99 >2013-12-09 12:25:26,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34021b99 >2013-12-09 12:25:27,081 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-16) No up server in cluster >2013-12-09 12:25:27,082 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-16) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:25:27,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 758cfe0 >2013-12-09 12:25:27,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterTasksListVDSCommand, return: [], log id: 758cfe0 >2013-12-09 12:25:31,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b040252 >2013-12-09 12:25:32,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b040252 >2013-12-09 12:25:32,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6298348c >2013-12-09 12:25:32,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6298348c >2013-12-09 12:25:37,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6deb30ff >2013-12-09 12:25:37,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6deb30ff >2013-12-09 12:25:37,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f9b3949 >2013-12-09 12:25:38,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f9b3949 >2013-12-09 12:25:43,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bd103ca >2013-12-09 12:25:43,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2bd103ca >2013-12-09 12:25:43,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e49c28d >2013-12-09 12:25:43,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e49c28d >2013-12-09 12:25:48,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e3e2175 >2013-12-09 12:25:49,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7e3e2175 >2013-12-09 12:25:49,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39296b25 >2013-12-09 12:25:49,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39296b25 >2013-12-09 12:25:54,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f6e7ceb >2013-12-09 12:25:55,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f6e7ceb >2013-12-09 12:25:55,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b3c1e58 >2013-12-09 12:25:55,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b3c1e58 >2013-12-09 12:26:00,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58bfbc6f >2013-12-09 12:26:01,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 58bfbc6f >2013-12-09 12:26:01,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38a595e1 >2013-12-09 12:26:01,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38a595e1 >2013-12-09 12:26:06,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d0e61e >2013-12-09 12:26:06,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4d0e61e >2013-12-09 12:26:06,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 182610c6 >2013-12-09 12:26:07,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 182610c6 >2013-12-09 12:26:12,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e865832 >2013-12-09 12:26:12,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e865832 >2013-12-09 12:26:12,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c53db9f >2013-12-09 12:26:12,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c53db9f >2013-12-09 12:26:17,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69f099bf >2013-12-09 12:26:18,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 69f099bf >2013-12-09 12:26:18,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68e350b7 >2013-12-09 12:26:18,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68e350b7 >2013-12-09 12:26:23,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7aee8160 >2013-12-09 12:26:24,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7aee8160 >2013-12-09 12:26:24,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2829abdf >2013-12-09 12:26:24,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2829abdf >2013-12-09 12:26:27,356 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-52) No up server in cluster >2013-12-09 12:26:27,356 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-52) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:26:27,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d0a333d >2013-12-09 12:26:27,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4d0a333d >2013-12-09 12:26:29,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 128031af >2013-12-09 12:26:29,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 128031af >2013-12-09 12:26:29,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4fbc90b2 >2013-12-09 12:26:30,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fbc90b2 >2013-12-09 12:26:35,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4508e528 >2013-12-09 12:26:35,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4508e528 >2013-12-09 12:26:35,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19fc810e >2013-12-09 12:26:35,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19fc810e >2013-12-09 12:26:40,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 561cc0b2 >2013-12-09 12:26:41,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 561cc0b2 >2013-12-09 12:26:41,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a2dd06b >2013-12-09 12:26:41,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a2dd06b >2013-12-09 12:26:46,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3cc0d06b >2013-12-09 12:26:47,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3cc0d06b >2013-12-09 12:26:47,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71eb6bc6 >2013-12-09 12:26:47,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71eb6bc6 >2013-12-09 12:26:52,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 294e5e6d >2013-12-09 12:26:52,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 294e5e6d >2013-12-09 12:26:52,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 757be45e >2013-12-09 12:26:53,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 757be45e >2013-12-09 12:26:58,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e786d1e >2013-12-09 12:26:58,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e786d1e >2013-12-09 12:26:58,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5cabb6f1 >2013-12-09 12:26:58,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cabb6f1 >2013-12-09 12:27:03,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b18fa01 >2013-12-09 12:27:04,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b18fa01 >2013-12-09 12:27:04,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7231bed2 >2013-12-09 12:27:04,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7231bed2 >2013-12-09 12:27:09,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b650d2a >2013-12-09 12:27:10,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3b650d2a >2013-12-09 12:27:10,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e05ab57 >2013-12-09 12:27:10,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e05ab57 >2013-12-09 12:27:15,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e4e51fe >2013-12-09 12:27:16,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4e4e51fe >2013-12-09 12:27:16,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1392c2f2 >2013-12-09 12:27:16,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1392c2f2 >2013-12-09 12:27:21,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a79c91b >2013-12-09 12:27:21,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4a79c91b >2013-12-09 12:27:21,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2522ce9d >2013-12-09 12:27:22,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2522ce9d >2013-12-09 12:27:27,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5539441c >2013-12-09 12:27:27,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5539441c >2013-12-09 12:27:27,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ce25dfa >2013-12-09 12:27:27,648 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-44) No up server in cluster >2013-12-09 12:27:27,648 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-44) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:27:27,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45ff3d1c >2013-12-09 12:27:27,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ce25dfa >2013-12-09 12:27:27,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterTasksListVDSCommand, return: [], log id: 45ff3d1c >2013-12-09 12:27:32,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d935524 >2013-12-09 12:27:33,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d935524 >2013-12-09 12:27:33,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46fc6970 >2013-12-09 12:27:33,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46fc6970 >2013-12-09 12:27:38,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14a4a7ca >2013-12-09 12:27:39,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 14a4a7ca >2013-12-09 12:27:39,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ed92768 >2013-12-09 12:27:39,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ed92768 >2013-12-09 12:27:44,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ca83927 >2013-12-09 12:27:44,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5ca83927 >2013-12-09 12:27:44,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1414ec84 >2013-12-09 12:27:45,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1414ec84 >2013-12-09 12:27:50,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36b796aa >2013-12-09 12:27:50,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 36b796aa >2013-12-09 12:27:50,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d9853db >2013-12-09 12:27:51,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d9853db >2013-12-09 12:27:56,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 442916b3 >2013-12-09 12:27:56,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 442916b3 >2013-12-09 12:27:56,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 241829e1 >2013-12-09 12:27:56,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 241829e1 >2013-12-09 12:28:01,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3469e842 >2013-12-09 12:28:02,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3469e842 >2013-12-09 12:28:02,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d6901cf >2013-12-09 12:28:02,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d6901cf >2013-12-09 12:28:07,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1440359a >2013-12-09 12:28:08,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1440359a >2013-12-09 12:28:08,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a5407a3 >2013-12-09 12:28:08,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a5407a3 >2013-12-09 12:28:13,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 798029d7 >2013-12-09 12:28:13,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 798029d7 >2013-12-09 12:28:13,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c80c8dc >2013-12-09 12:28:14,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c80c8dc >2013-12-09 12:28:19,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39b040a5 >2013-12-09 12:28:19,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 39b040a5 >2013-12-09 12:28:19,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2caa519c >2013-12-09 12:28:19,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2caa519c >2013-12-09 12:28:24,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73861017 >2013-12-09 12:28:25,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 73861017 >2013-12-09 12:28:25,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41c999a2 >2013-12-09 12:28:25,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41c999a2 >2013-12-09 12:28:27,926 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-87) No up server in cluster >2013-12-09 12:28:27,926 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-87) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:28:27,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67faf5ba >2013-12-09 12:28:28,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterTasksListVDSCommand, return: [], log id: 67faf5ba >2013-12-09 12:28:30,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b93cb5b >2013-12-09 12:28:31,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b93cb5b >2013-12-09 12:28:31,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 438655de >2013-12-09 12:28:31,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 438655de >2013-12-09 12:28:36,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 177a7077 >2013-12-09 12:28:36,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 177a7077 >2013-12-09 12:28:36,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d6066f9 >2013-12-09 12:28:37,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d6066f9 >2013-12-09 12:28:42,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 764eddab >2013-12-09 12:28:42,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 764eddab >2013-12-09 12:28:42,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e50438a >2013-12-09 12:28:43,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e50438a >2013-12-09 12:28:48,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4460c428 >2013-12-09 12:28:48,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4460c428 >2013-12-09 12:28:48,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e0ff088 >2013-12-09 12:28:48,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e0ff088 >2013-12-09 12:28:53,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 588328d8 >2013-12-09 12:28:54,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 588328d8 >2013-12-09 12:28:54,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 113203f7 >2013-12-09 12:28:54,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 113203f7 >2013-12-09 12:28:59,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30a1989 >2013-12-09 12:29:00,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 30a1989 >2013-12-09 12:29:00,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78820b6b >2013-12-09 12:29:00,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78820b6b >2013-12-09 12:29:05,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67e5b9a0 >2013-12-09 12:29:05,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 67e5b9a0 >2013-12-09 12:29:05,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 194ef8dc >2013-12-09 12:29:06,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 194ef8dc >2013-12-09 12:29:11,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36d15ff6 >2013-12-09 12:29:11,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 36d15ff6 >2013-12-09 12:29:11,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 494e9a4f >2013-12-09 12:29:11,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 494e9a4f >2013-12-09 12:29:16,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ab0c469 >2013-12-09 12:29:17,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7ab0c469 >2013-12-09 12:29:17,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f162daf >2013-12-09 12:29:17,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f162daf >2013-12-09 12:29:22,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ac3df12 >2013-12-09 12:29:23,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2ac3df12 >2013-12-09 12:29:23,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78a5aedd >2013-12-09 12:29:23,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78a5aedd >2013-12-09 12:29:28,208 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-66) No up server in cluster >2013-12-09 12:29:28,208 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-66) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:29:28,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e3e49f0 >2013-12-09 12:29:28,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6e3e49f0 >2013-12-09 12:29:28,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e330eb0 >2013-12-09 12:29:29,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7e330eb0 >2013-12-09 12:29:29,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4fe4be6e >2013-12-09 12:29:29,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fe4be6e >2013-12-09 12:29:34,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39067dc3 >2013-12-09 12:29:34,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 39067dc3 >2013-12-09 12:29:34,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c23face >2013-12-09 12:29:35,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c23face >2013-12-09 12:29:40,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 298d9323 >2013-12-09 12:29:40,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 298d9323 >2013-12-09 12:29:40,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ef54ed6 >2013-12-09 12:29:40,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ef54ed6 >2013-12-09 12:29:45,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a2cdcfa >2013-12-09 12:29:46,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6a2cdcfa >2013-12-09 12:29:46,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1793bdd6 >2013-12-09 12:29:46,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1793bdd6 >2013-12-09 12:29:51,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c5b8f08 >2013-12-09 12:29:52,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4c5b8f08 >2013-12-09 12:29:52,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1adc79d8 >2013-12-09 12:29:52,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1adc79d8 >2013-12-09 12:29:57,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 25ff6e7f >2013-12-09 12:29:57,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 25ff6e7f >2013-12-09 12:29:57,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 616e6179 >2013-12-09 12:29:58,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 616e6179 >2013-12-09 12:30:03,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 798d9e97 >2013-12-09 12:30:03,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 798d9e97 >2013-12-09 12:30:03,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7676026b >2013-12-09 12:30:03,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7676026b >2013-12-09 12:30:08,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 799931af >2013-12-09 12:30:09,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 799931af >2013-12-09 12:30:09,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 362c2e4c >2013-12-09 12:30:09,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 362c2e4c >2013-12-09 12:30:14,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 589b1d26 >2013-12-09 12:30:15,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 589b1d26 >2013-12-09 12:30:15,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5dbf49ad >2013-12-09 12:30:15,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5dbf49ad >2013-12-09 12:30:20,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a8aebc2 >2013-12-09 12:30:21,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: a8aebc2 >2013-12-09 12:30:21,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 179a9ae1 >2013-12-09 12:30:21,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 179a9ae1 >2013-12-09 12:30:26,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29fa23ff >2013-12-09 12:30:26,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 29fa23ff >2013-12-09 12:30:26,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b65f7a2 >2013-12-09 12:30:27,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b65f7a2 >2013-12-09 12:30:28,487 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-86) No up server in cluster >2013-12-09 12:30:28,487 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-86) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:30:28,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6add987f >2013-12-09 12:30:28,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6add987f >2013-12-09 12:30:32,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 561c3703 >2013-12-09 12:30:32,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 561c3703 >2013-12-09 12:30:32,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 270cb867 >2013-12-09 12:30:32,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 270cb867 >2013-12-09 12:30:37,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 672166d6 >2013-12-09 12:30:38,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 672166d6 >2013-12-09 12:30:38,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: cefef68 >2013-12-09 12:30:38,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: cefef68 >2013-12-09 12:30:43,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 364ea95c >2013-12-09 12:30:44,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 364ea95c >2013-12-09 12:30:44,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60118bc >2013-12-09 12:30:44,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60118bc >2013-12-09 12:30:49,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7dc1af95 >2013-12-09 12:30:49,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7dc1af95 >2013-12-09 12:30:49,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: dff5971 >2013-12-09 12:30:50,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: dff5971 >2013-12-09 12:30:55,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ab1638b >2013-12-09 12:30:55,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6ab1638b >2013-12-09 12:30:55,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52133ffb >2013-12-09 12:30:55,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52133ffb >2013-12-09 12:31:00,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58a44b36 >2013-12-09 12:31:01,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 58a44b36 >2013-12-09 12:31:01,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5609caa5 >2013-12-09 12:31:01,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5609caa5 >2013-12-09 12:31:06,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c88e375 >2013-12-09 12:31:07,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c88e375 >2013-12-09 12:31:07,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 310da702 >2013-12-09 12:31:07,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 310da702 >2013-12-09 12:31:12,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32d864ea >2013-12-09 12:31:13,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 32d864ea >2013-12-09 12:31:13,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46f53d88 >2013-12-09 12:31:13,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46f53d88 >2013-12-09 12:31:18,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72897d95 >2013-12-09 12:31:18,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 72897d95 >2013-12-09 12:31:18,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48c9db6f >2013-12-09 12:31:19,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48c9db6f >2013-12-09 12:31:24,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2975e839 >2013-12-09 12:31:24,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2975e839 >2013-12-09 12:31:24,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a5c7b80 >2013-12-09 12:31:24,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a5c7b80 >2013-12-09 12:31:28,769 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-35) No up server in cluster >2013-12-09 12:31:28,769 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-35) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:31:28,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ea4d2a1 >2013-12-09 12:31:29,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2ea4d2a1 >2013-12-09 12:31:29,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12364d3a >2013-12-09 12:31:30,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 12364d3a >2013-12-09 12:31:30,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a0ef5c6 >2013-12-09 12:31:30,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a0ef5c6 >2013-12-09 12:31:35,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16949a39 >2013-12-09 12:31:36,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 16949a39 >2013-12-09 12:31:36,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33c77b36 >2013-12-09 12:31:36,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33c77b36 >2013-12-09 12:31:41,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b3ad9e4 >2013-12-09 12:31:41,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b3ad9e4 >2013-12-09 12:31:41,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37a48aae >2013-12-09 12:31:42,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37a48aae >2013-12-09 12:31:47,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 589f8eaf >2013-12-09 12:31:47,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 589f8eaf >2013-12-09 12:31:47,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a2a8cb3 >2013-12-09 12:31:47,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a2a8cb3 >2013-12-09 12:31:52,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9379566 >2013-12-09 12:31:53,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 9379566 >2013-12-09 12:31:53,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c9d9b38 >2013-12-09 12:31:53,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c9d9b38 >2013-12-09 12:31:58,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 49b9012e >2013-12-09 12:31:59,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 49b9012e >2013-12-09 12:31:59,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 790a8972 >2013-12-09 12:31:59,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 790a8972 >2013-12-09 12:32:04,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57bfb0bc >2013-12-09 12:32:05,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 57bfb0bc >2013-12-09 12:32:05,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51dfbf68 >2013-12-09 12:32:05,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51dfbf68 >2013-12-09 12:32:10,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b183b4b >2013-12-09 12:32:10,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b183b4b >2013-12-09 12:32:10,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a38576 >2013-12-09 12:32:11,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a38576 >2013-12-09 12:32:16,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1cd6ae52 >2013-12-09 12:32:16,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1cd6ae52 >2013-12-09 12:32:16,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 467fb8d9 >2013-12-09 12:32:16,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 467fb8d9 >2013-12-09 12:32:21,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 649185a6 >2013-12-09 12:32:22,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 649185a6 >2013-12-09 12:32:22,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e5977c4 >2013-12-09 12:32:22,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e5977c4 >2013-12-09 12:32:27,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78be7b81 >2013-12-09 12:32:28,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 78be7b81 >2013-12-09 12:32:28,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51b8f8bc >2013-12-09 12:32:28,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51b8f8bc >2013-12-09 12:32:29,057 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-25) No up server in cluster >2013-12-09 12:32:29,057 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-25) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:32:29,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 231a38bf >2013-12-09 12:32:29,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterTasksListVDSCommand, return: [], log id: 231a38bf >2013-12-09 12:32:33,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3632ade0 >2013-12-09 12:32:33,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3632ade0 >2013-12-09 12:32:33,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f1032c2 >2013-12-09 12:32:34,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f1032c2 >2013-12-09 12:32:39,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 611ca30b >2013-12-09 12:32:39,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 611ca30b >2013-12-09 12:32:39,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50a03fba >2013-12-09 12:32:39,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50a03fba >2013-12-09 12:32:44,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76bfcfe4 >2013-12-09 12:32:45,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 76bfcfe4 >2013-12-09 12:32:45,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4fff949a >2013-12-09 12:32:45,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fff949a >2013-12-09 12:32:50,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4108025 >2013-12-09 12:32:51,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4108025 >2013-12-09 12:32:51,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4977ab8a >2013-12-09 12:32:51,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4977ab8a >2013-12-09 12:32:56,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51ec4068 >2013-12-09 12:32:57,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 51ec4068 >2013-12-09 12:32:57,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b1f00b3 >2013-12-09 12:32:57,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b1f00b3 >2013-12-09 12:33:02,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b920037 >2013-12-09 12:33:02,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b920037 >2013-12-09 12:33:02,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1aa6fff6 >2013-12-09 12:33:03,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1aa6fff6 >2013-12-09 12:33:08,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37602f2a >2013-12-09 12:33:08,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 37602f2a >2013-12-09 12:33:08,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4030a9ef >2013-12-09 12:33:08,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4030a9ef >2013-12-09 12:33:13,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5becb3c5 >2013-12-09 12:33:14,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5becb3c5 >2013-12-09 12:33:14,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c443de3 >2013-12-09 12:33:14,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c443de3 >2013-12-09 12:33:19,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5450f4b0 >2013-12-09 12:33:20,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5450f4b0 >2013-12-09 12:33:20,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 243f3cb3 >2013-12-09 12:33:20,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 243f3cb3 >2013-12-09 12:33:25,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 759ede7 >2013-12-09 12:33:26,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 759ede7 >2013-12-09 12:33:26,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 728eec02 >2013-12-09 12:33:26,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 728eec02 >2013-12-09 12:33:29,334 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-98) No up server in cluster >2013-12-09 12:33:29,334 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-98) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:33:29,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7261c12d >2013-12-09 12:33:29,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7261c12d >2013-12-09 12:33:31,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 239c8676 >2013-12-09 12:33:31,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 239c8676 >2013-12-09 12:33:31,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 470f703e >2013-12-09 12:33:32,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 470f703e >2013-12-09 12:33:37,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a403b20 >2013-12-09 12:33:37,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2a403b20 >2013-12-09 12:33:37,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e3c234f >2013-12-09 12:33:37,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e3c234f >2013-12-09 12:33:42,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69e7ead9 >2013-12-09 12:33:43,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 69e7ead9 >2013-12-09 12:33:43,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e612006 >2013-12-09 12:33:43,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e612006 >2013-12-09 12:33:48,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59f2ef3c >2013-12-09 12:33:49,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59f2ef3c >2013-12-09 12:33:49,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 789c6eef >2013-12-09 12:33:49,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 789c6eef >2013-12-09 12:33:54,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10c63ff6 >2013-12-09 12:33:54,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 10c63ff6 >2013-12-09 12:33:54,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e6e307 >2013-12-09 12:33:55,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e6e307 >2013-12-09 12:34:00,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ab057dc >2013-12-09 12:34:00,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5ab057dc >2013-12-09 12:34:00,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7909a509 >2013-12-09 12:34:01,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7909a509 >2013-12-09 12:34:06,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73a0f923 >2013-12-09 12:34:06,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 73a0f923 >2013-12-09 12:34:06,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16cf4d48 >2013-12-09 12:34:06,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16cf4d48 >2013-12-09 12:34:11,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4200b561 >2013-12-09 12:34:12,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4200b561 >2013-12-09 12:34:12,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4028bde2 >2013-12-09 12:34:12,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4028bde2 >2013-12-09 12:34:17,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6216247e >2013-12-09 12:34:18,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6216247e >2013-12-09 12:34:18,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27a1377e >2013-12-09 12:34:18,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27a1377e >2013-12-09 12:34:23,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5eab6c43 >2013-12-09 12:34:23,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5eab6c43 >2013-12-09 12:34:23,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f2f089f >2013-12-09 12:34:24,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f2f089f >2013-12-09 12:34:29,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d4488f2 >2013-12-09 12:34:29,628 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-76) No up server in cluster >2013-12-09 12:34:29,628 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-76) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:34:29,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79ef366c >2013-12-09 12:34:29,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d4488f2 >2013-12-09 12:34:29,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c6a8933 >2013-12-09 12:34:29,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterTasksListVDSCommand, return: [], log id: 79ef366c >2013-12-09 12:34:29,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c6a8933 >2013-12-09 12:34:34,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47ff5fd4 >2013-12-09 12:34:35,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 47ff5fd4 >2013-12-09 12:34:35,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 586acf79 >2013-12-09 12:34:35,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 586acf79 >2013-12-09 12:34:40,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 455e0645 >2013-12-09 12:34:41,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 455e0645 >2013-12-09 12:34:41,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73d89cba >2013-12-09 12:34:41,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73d89cba >2013-12-09 12:34:46,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10da8726 >2013-12-09 12:34:47,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 10da8726 >2013-12-09 12:34:47,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c62c1ad >2013-12-09 12:34:47,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c62c1ad >2013-12-09 12:34:52,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7913dd12 >2013-12-09 12:34:52,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7913dd12 >2013-12-09 12:34:52,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62851789 >2013-12-09 12:34:53,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62851789 >2013-12-09 12:34:58,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57a64438 >2013-12-09 12:34:58,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 57a64438 >2013-12-09 12:34:58,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60e6aa9f >2013-12-09 12:34:58,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60e6aa9f >2013-12-09 12:35:03,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 929f8f >2013-12-09 12:35:04,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 929f8f >2013-12-09 12:35:04,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27bd463b >2013-12-09 12:35:04,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27bd463b >2013-12-09 12:35:09,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c0bd865 >2013-12-09 12:35:10,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1c0bd865 >2013-12-09 12:35:10,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31b0a51b >2013-12-09 12:35:10,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31b0a51b >2013-12-09 12:35:15,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7edef86f >2013-12-09 12:35:15,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7edef86f >2013-12-09 12:35:15,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17053bb8 >2013-12-09 12:35:16,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17053bb8 >2013-12-09 12:35:21,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a78944f >2013-12-09 12:35:21,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a78944f >2013-12-09 12:35:21,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66aae040 >2013-12-09 12:35:21,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66aae040 >2013-12-09 12:35:26,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ea3ad0f >2013-12-09 12:35:27,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4ea3ad0f >2013-12-09 12:35:27,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 410012ba >2013-12-09 12:35:27,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 410012ba >2013-12-09 12:35:29,896 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-11) No up server in cluster >2013-12-09 12:35:29,896 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-11) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:35:29,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27ab9eaf >2013-12-09 12:35:30,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterTasksListVDSCommand, return: [], log id: 27ab9eaf >2013-12-09 12:35:32,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31708b66 >2013-12-09 12:35:33,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 31708b66 >2013-12-09 12:35:33,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4bc042f >2013-12-09 12:35:33,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4bc042f >2013-12-09 12:35:38,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3122af95 >2013-12-09 12:35:39,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3122af95 >2013-12-09 12:35:39,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e8e5925 >2013-12-09 12:35:39,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e8e5925 >2013-12-09 12:35:44,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10a4e73d >2013-12-09 12:35:44,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 10a4e73d >2013-12-09 12:35:44,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 22d9242b >2013-12-09 12:35:45,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22d9242b >2013-12-09 12:35:50,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4eb02181 >2013-12-09 12:35:50,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4eb02181 >2013-12-09 12:35:50,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39a86498 >2013-12-09 12:35:50,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39a86498 >2013-12-09 12:35:55,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6387b403 >2013-12-09 12:35:56,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6387b403 >2013-12-09 12:35:56,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4525e3e7 >2013-12-09 12:35:56,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4525e3e7 >2013-12-09 12:36:01,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 214e7b8 >2013-12-09 12:36:02,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 214e7b8 >2013-12-09 12:36:02,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71f751ed >2013-12-09 12:36:02,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71f751ed >2013-12-09 12:36:07,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d73a62b >2013-12-09 12:36:07,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d73a62b >2013-12-09 12:36:07,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3246eabc >2013-12-09 12:36:08,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3246eabc >2013-12-09 12:36:13,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 683a3c79 >2013-12-09 12:36:13,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 683a3c79 >2013-12-09 12:36:13,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: aa97ab >2013-12-09 12:36:13,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: aa97ab >2013-12-09 12:36:18,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 787d7cf1 >2013-12-09 12:36:19,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 787d7cf1 >2013-12-09 12:36:19,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35b5677a >2013-12-09 12:36:19,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35b5677a >2013-12-09 12:36:24,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a4443d7 >2013-12-09 12:36:25,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3a4443d7 >2013-12-09 12:36:25,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34c9e429 >2013-12-09 12:36:25,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34c9e429 >2013-12-09 12:36:30,175 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-50) No up server in cluster >2013-12-09 12:36:30,176 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-50) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:36:30,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a479985 >2013-12-09 12:36:30,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2a479985 >2013-12-09 12:36:30,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 461be32d >2013-12-09 12:36:31,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 461be32d >2013-12-09 12:36:31,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3790df3b >2013-12-09 12:36:31,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3790df3b >2013-12-09 12:36:36,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2fb09354 >2013-12-09 12:36:36,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2fb09354 >2013-12-09 12:36:36,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21ccb7b2 >2013-12-09 12:36:37,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21ccb7b2 >2013-12-09 12:36:42,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c891aa9 >2013-12-09 12:36:42,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c891aa9 >2013-12-09 12:36:42,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 525e32ee >2013-12-09 12:36:42,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 525e32ee >2013-12-09 12:36:47,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14bb848 >2013-12-09 12:36:48,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 14bb848 >2013-12-09 12:36:48,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19fd9c0a >2013-12-09 12:36:48,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19fd9c0a >2013-12-09 12:36:53,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43ca0c02 >2013-12-09 12:36:54,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 43ca0c02 >2013-12-09 12:36:54,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26ec0ca3 >2013-12-09 12:36:54,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26ec0ca3 >2013-12-09 12:36:59,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10f02e20 >2013-12-09 12:36:59,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 10f02e20 >2013-12-09 12:36:59,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6bb5fff >2013-12-09 12:37:00,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6bb5fff >2013-12-09 12:37:05,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a357cb9 >2013-12-09 12:37:05,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a357cb9 >2013-12-09 12:37:05,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c301a64 >2013-12-09 12:37:06,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c301a64 >2013-12-09 12:37:11,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31f0fedc >2013-12-09 12:37:11,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 31f0fedc >2013-12-09 12:37:11,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1162391 >2013-12-09 12:37:11,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1162391 >2013-12-09 12:37:16,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18cec9ef >2013-12-09 12:37:17,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 18cec9ef >2013-12-09 12:37:17,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4dc4c87 >2013-12-09 12:37:17,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4dc4c87 >2013-12-09 12:37:22,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5de6e7f8 >2013-12-09 12:37:23,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5de6e7f8 >2013-12-09 12:37:23,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14b8a442 >2013-12-09 12:37:23,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14b8a442 >2013-12-09 12:37:28,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c73eadf >2013-12-09 12:37:28,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c73eadf >2013-12-09 12:37:28,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29442c7b >2013-12-09 12:37:29,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29442c7b >2013-12-09 12:37:30,468 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-49) No up server in cluster >2013-12-09 12:37:30,468 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-49) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:37:30,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2502ed38 >2013-12-09 12:37:30,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2502ed38 >2013-12-09 12:37:34,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 230dd843 >2013-12-09 12:37:34,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 230dd843 >2013-12-09 12:37:34,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8d660f9 >2013-12-09 12:37:34,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8d660f9 >2013-12-09 12:37:39,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bcd0142 >2013-12-09 12:37:40,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1bcd0142 >2013-12-09 12:37:40,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 735ee34a >2013-12-09 12:37:40,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 735ee34a >2013-12-09 12:37:45,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 754e60bd >2013-12-09 12:37:46,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 754e60bd >2013-12-09 12:37:46,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3210fea3 >2013-12-09 12:37:46,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3210fea3 >2013-12-09 12:37:51,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b16b151 >2013-12-09 12:37:52,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: b16b151 >2013-12-09 12:37:52,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d06bef9 >2013-12-09 12:37:52,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d06bef9 >2013-12-09 12:37:57,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f0e94c >2013-12-09 12:37:57,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: f0e94c >2013-12-09 12:37:57,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b52e9d0 >2013-12-09 12:37:58,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b52e9d0 >2013-12-09 12:38:03,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28576899 >2013-12-09 12:38:03,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 28576899 >2013-12-09 12:38:03,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75932c83 >2013-12-09 12:38:03,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75932c83 >2013-12-09 12:38:08,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4525ec18 >2013-12-09 12:38:09,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4525ec18 >2013-12-09 12:38:09,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c1a3fa0 >2013-12-09 12:38:09,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c1a3fa0 >2013-12-09 12:38:14,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5cc6797d >2013-12-09 12:38:15,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5cc6797d >2013-12-09 12:38:15,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4763e4f5 >2013-12-09 12:38:15,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4763e4f5 >2013-12-09 12:38:20,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10fdfb3c >2013-12-09 12:38:20,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 10fdfb3c >2013-12-09 12:38:20,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7aa36699 >2013-12-09 12:38:21,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7aa36699 >2013-12-09 12:38:26,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c66ee06 >2013-12-09 12:38:26,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5c66ee06 >2013-12-09 12:38:26,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e3c814 >2013-12-09 12:38:26,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e3c814 >2013-12-09 12:38:30,758 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-27) No up server in cluster >2013-12-09 12:38:30,758 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-27) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:38:30,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c55ba4b >2013-12-09 12:38:31,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3c55ba4b >2013-12-09 12:38:31,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64572145 >2013-12-09 12:38:32,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 64572145 >2013-12-09 12:38:32,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4bb7a9b1 >2013-12-09 12:38:32,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4bb7a9b1 >2013-12-09 12:38:37,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39f1d88a >2013-12-09 12:38:38,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 39f1d88a >2013-12-09 12:38:38,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3000c568 >2013-12-09 12:38:38,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3000c568 >2013-12-09 12:38:43,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c5d9186 >2013-12-09 12:38:44,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c5d9186 >2013-12-09 12:38:44,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f0c9b9d >2013-12-09 12:38:44,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f0c9b9d >2013-12-09 12:38:49,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41a9aed0 >2013-12-09 12:38:49,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 41a9aed0 >2013-12-09 12:38:49,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5164b8b2 >2013-12-09 12:38:50,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5164b8b2 >2013-12-09 12:38:55,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a99bda4 >2013-12-09 12:38:55,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a99bda4 >2013-12-09 12:38:55,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13e82133 >2013-12-09 12:38:55,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13e82133 >2013-12-09 12:39:00,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c247beb >2013-12-09 12:39:01,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c247beb >2013-12-09 12:39:01,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7239a370 >2013-12-09 12:39:01,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7239a370 >2013-12-09 12:39:06,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1797ce6 >2013-12-09 12:39:07,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1797ce6 >2013-12-09 12:39:07,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 303ea917 >2013-12-09 12:39:07,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 303ea917 >2013-12-09 12:39:12,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48f5fea7 >2013-12-09 12:39:12,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 48f5fea7 >2013-12-09 12:39:12,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5226649c >2013-12-09 12:39:13,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5226649c >2013-12-09 12:39:18,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12bafb02 >2013-12-09 12:39:18,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 12bafb02 >2013-12-09 12:39:18,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7731df86 >2013-12-09 12:39:18,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7731df86 >2013-12-09 12:39:23,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 217c22d7 >2013-12-09 12:39:24,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 217c22d7 >2013-12-09 12:39:24,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64ea273b >2013-12-09 12:39:24,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64ea273b >2013-12-09 12:39:29,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e803354 >2013-12-09 12:39:30,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3e803354 >2013-12-09 12:39:30,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75980657 >2013-12-09 12:39:30,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75980657 >2013-12-09 12:39:31,038 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-58) No up server in cluster >2013-12-09 12:39:31,038 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-58) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:39:31,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 616575a0 >2013-12-09 12:39:31,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterTasksListVDSCommand, return: [], log id: 616575a0 >2013-12-09 12:39:35,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43b208a8 >2013-12-09 12:39:36,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 43b208a8 >2013-12-09 12:39:36,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77413434 >2013-12-09 12:39:36,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77413434 >2013-12-09 12:39:41,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47d88e7e >2013-12-09 12:39:41,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 47d88e7e >2013-12-09 12:39:41,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 252fdb7f >2013-12-09 12:39:42,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 252fdb7f >2013-12-09 12:39:47,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1757b479 >2013-12-09 12:39:47,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1757b479 >2013-12-09 12:39:47,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69323ffc >2013-12-09 12:39:47,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69323ffc >2013-12-09 12:39:52,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69526b28 >2013-12-09 12:39:53,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 69526b28 >2013-12-09 12:39:53,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17886fcb >2013-12-09 12:39:53,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17886fcb >2013-12-09 12:39:58,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 430bb356 >2013-12-09 12:39:59,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 430bb356 >2013-12-09 12:39:59,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76f68fc2 >2013-12-09 12:39:59,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76f68fc2 >2013-12-09 12:40:04,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b759930 >2013-12-09 12:40:04,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b759930 >2013-12-09 12:40:04,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69bb2cae >2013-12-09 12:40:05,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69bb2cae >2013-12-09 12:40:10,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3aec7254 >2013-12-09 12:40:10,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3aec7254 >2013-12-09 12:40:10,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ae5b6bf >2013-12-09 12:40:10,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ae5b6bf >2013-12-09 12:40:15,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5567dc5b >2013-12-09 12:40:16,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5567dc5b >2013-12-09 12:40:16,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: baeadf6 >2013-12-09 12:40:16,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: baeadf6 >2013-12-09 12:40:21,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6bc74011 >2013-12-09 12:40:22,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6bc74011 >2013-12-09 12:40:22,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56a6e146 >2013-12-09 12:40:22,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56a6e146 >2013-12-09 12:40:27,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72767a33 >2013-12-09 12:40:28,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 72767a33 >2013-12-09 12:40:28,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30345e98 >2013-12-09 12:40:28,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30345e98 >2013-12-09 12:40:31,337 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-40) No up server in cluster >2013-12-09 12:40:31,337 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-40) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:40:31,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7acceb9f >2013-12-09 12:40:31,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7acceb9f >2013-12-09 12:40:33,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 221890da >2013-12-09 12:40:33,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 221890da >2013-12-09 12:40:33,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f25adf6 >2013-12-09 12:40:34,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f25adf6 >2013-12-09 12:40:39,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c92acac >2013-12-09 12:40:39,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6c92acac >2013-12-09 12:40:39,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a7c1bd7 >2013-12-09 12:40:39,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a7c1bd7 >2013-12-09 12:40:44,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13248d47 >2013-12-09 12:40:45,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 13248d47 >2013-12-09 12:40:45,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2250a07c >2013-12-09 12:40:45,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2250a07c >2013-12-09 12:40:50,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 669a4224 >2013-12-09 12:40:51,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 669a4224 >2013-12-09 12:40:51,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d13ab79 >2013-12-09 12:40:51,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d13ab79 >2013-12-09 12:40:56,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f506859 >2013-12-09 12:40:56,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3f506859 >2013-12-09 12:40:56,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38767e30 >2013-12-09 12:40:57,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38767e30 >2013-12-09 12:41:02,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6dda1237 >2013-12-09 12:41:02,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6dda1237 >2013-12-09 12:41:02,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15c9d693 >2013-12-09 12:41:03,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15c9d693 >2013-12-09 12:41:08,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 673cc296 >2013-12-09 12:41:08,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 673cc296 >2013-12-09 12:41:08,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f635103 >2013-12-09 12:41:08,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f635103 >2013-12-09 12:41:13,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3efe01fd >2013-12-09 12:41:14,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3efe01fd >2013-12-09 12:41:14,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f159e97 >2013-12-09 12:41:14,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f159e97 >2013-12-09 12:41:19,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3edf181f >2013-12-09 12:41:20,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3edf181f >2013-12-09 12:41:20,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d1ab5b3 >2013-12-09 12:41:20,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d1ab5b3 >2013-12-09 12:41:25,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4fae390a >2013-12-09 12:41:25,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4fae390a >2013-12-09 12:41:25,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72221cd5 >2013-12-09 12:41:26,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72221cd5 >2013-12-09 12:41:31,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a3f5548 >2013-12-09 12:41:31,617 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-39) [63f3d095] No up server in cluster >2013-12-09 12:41:31,617 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-39) [63f3d095] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:41:31,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f5f09ba >2013-12-09 12:41:31,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7a3f5548 >2013-12-09 12:41:31,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73f26609 >2013-12-09 12:41:31,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterTasksListVDSCommand, return: [], log id: 7f5f09ba >2013-12-09 12:41:31,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73f26609 >2013-12-09 12:41:36,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19daa7f2 >2013-12-09 12:41:37,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19daa7f2 >2013-12-09 12:41:37,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7841ac61 >2013-12-09 12:41:37,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7841ac61 >2013-12-09 12:41:42,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70ce1182 >2013-12-09 12:41:43,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 70ce1182 >2013-12-09 12:41:43,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34f96c32 >2013-12-09 12:41:43,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34f96c32 >2013-12-09 12:41:48,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19a66fed >2013-12-09 12:41:49,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 19a66fed >2013-12-09 12:41:49,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fd1bf37 >2013-12-09 12:41:49,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fd1bf37 >2013-12-09 12:41:54,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14e4490b >2013-12-09 12:41:54,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 14e4490b >2013-12-09 12:41:54,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66ccc8c5 >2013-12-09 12:41:55,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66ccc8c5 >2013-12-09 12:42:00,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1df385c6 >2013-12-09 12:42:00,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1df385c6 >2013-12-09 12:42:00,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 292d1bf1 >2013-12-09 12:42:00,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 292d1bf1 >2013-12-09 12:42:05,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 728f25c >2013-12-09 12:42:06,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 728f25c >2013-12-09 12:42:06,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5fd77ca >2013-12-09 12:42:06,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fd77ca >2013-12-09 12:42:11,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7429ccfb >2013-12-09 12:42:12,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7429ccfb >2013-12-09 12:42:12,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 534d9863 >2013-12-09 12:42:12,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 534d9863 >2013-12-09 12:42:17,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3895edc7 >2013-12-09 12:42:17,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3895edc7 >2013-12-09 12:42:17,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ad9f115 >2013-12-09 12:42:18,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ad9f115 >2013-12-09 12:42:23,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4594560a >2013-12-09 12:42:23,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4594560a >2013-12-09 12:42:23,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 44671964 >2013-12-09 12:42:23,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44671964 >2013-12-09 12:42:28,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54b52d52 >2013-12-09 12:42:29,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 54b52d52 >2013-12-09 12:42:29,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44e8e4c7 >2013-12-09 12:42:29,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44e8e4c7 >2013-12-09 12:42:31,869 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2013-12-09 12:42:31,869 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:42:31,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20270f42 >2013-12-09 12:42:32,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterTasksListVDSCommand, return: [], log id: 20270f42 >2013-12-09 12:42:34,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17e466fe >2013-12-09 12:42:35,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 17e466fe >2013-12-09 12:42:35,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 645be797 >2013-12-09 12:42:35,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 645be797 >2013-12-09 12:42:40,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 304fdcd0 >2013-12-09 12:42:41,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 304fdcd0 >2013-12-09 12:42:41,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19e0d1cc >2013-12-09 12:42:41,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19e0d1cc >2013-12-09 12:42:46,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d490340 >2013-12-09 12:42:46,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6d490340 >2013-12-09 12:42:46,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e28e47e >2013-12-09 12:42:47,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e28e47e >2013-12-09 12:42:52,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d358c0f >2013-12-09 12:42:52,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6d358c0f >2013-12-09 12:42:52,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 622f9917 >2013-12-09 12:42:52,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 622f9917 >2013-12-09 12:42:57,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 201a73a >2013-12-09 12:42:58,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 201a73a >2013-12-09 12:42:58,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 28824fcd >2013-12-09 12:42:58,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28824fcd >2013-12-09 12:43:03,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a3dcd87 >2013-12-09 12:43:04,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a3dcd87 >2013-12-09 12:43:04,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 743da1f >2013-12-09 12:43:04,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 743da1f >2013-12-09 12:43:09,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f2ff3de >2013-12-09 12:43:09,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f2ff3de >2013-12-09 12:43:09,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64129d64 >2013-12-09 12:43:10,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64129d64 >2013-12-09 12:43:15,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ac1ce41 >2013-12-09 12:43:15,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ac1ce41 >2013-12-09 12:43:15,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3056510a >2013-12-09 12:43:15,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3056510a >2013-12-09 12:43:20,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bd791af >2013-12-09 12:43:21,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4bd791af >2013-12-09 12:43:21,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2deebc8b >2013-12-09 12:43:21,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2deebc8b >2013-12-09 12:43:26,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35a5cffa >2013-12-09 12:43:27,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 35a5cffa >2013-12-09 12:43:27,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a9af4a3 >2013-12-09 12:43:27,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a9af4a3 >2013-12-09 12:43:32,153 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) No up server in cluster >2013-12-09 12:43:32,153 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:43:32,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7bf4610b >2013-12-09 12:43:32,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7bf4610b >2013-12-09 12:43:32,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ba03955 >2013-12-09 12:43:33,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4ba03955 >2013-12-09 12:43:33,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 443a6fb2 >2013-12-09 12:43:33,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 443a6fb2 >2013-12-09 12:43:38,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 14f64d79 >2013-12-09 12:43:38,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 14f64d79 >2013-12-09 12:43:38,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18851652 >2013-12-09 12:43:39,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18851652 >2013-12-09 12:43:44,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35f28838 >2013-12-09 12:43:44,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 35f28838 >2013-12-09 12:43:44,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 260740b >2013-12-09 12:43:44,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 260740b >2013-12-09 12:43:49,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d173c5c >2013-12-09 12:43:50,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d173c5c >2013-12-09 12:43:50,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43ecfa26 >2013-12-09 12:43:50,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43ecfa26 >2013-12-09 12:43:55,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b67bbe9 >2013-12-09 12:43:56,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4b67bbe9 >2013-12-09 12:43:56,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4fa35d63 >2013-12-09 12:43:56,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fa35d63 >2013-12-09 12:44:01,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 623a1a29 >2013-12-09 12:44:01,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 623a1a29 >2013-12-09 12:44:01,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54965d0c >2013-12-09 12:44:02,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54965d0c >2013-12-09 12:44:07,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e099331 >2013-12-09 12:44:07,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e099331 >2013-12-09 12:44:07,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 260029c8 >2013-12-09 12:44:08,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 260029c8 >2013-12-09 12:44:13,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d03c455 >2013-12-09 12:44:13,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d03c455 >2013-12-09 12:44:13,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76d2dab5 >2013-12-09 12:44:13,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76d2dab5 >2013-12-09 12:44:18,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a32efc4 >2013-12-09 12:44:19,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4a32efc4 >2013-12-09 12:44:19,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 28930981 >2013-12-09 12:44:19,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28930981 >2013-12-09 12:44:24,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1436ab69 >2013-12-09 12:44:25,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1436ab69 >2013-12-09 12:44:25,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2047ecaa >2013-12-09 12:44:25,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2047ecaa >2013-12-09 12:44:30,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48c0b7fe >2013-12-09 12:44:30,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 48c0b7fe >2013-12-09 12:44:30,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 198fb3d2 >2013-12-09 12:44:31,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 198fb3d2 >2013-12-09 12:44:32,451 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-89) No up server in cluster >2013-12-09 12:44:32,451 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-89) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:44:32,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31f1aefc >2013-12-09 12:44:32,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterTasksListVDSCommand, return: [], log id: 31f1aefc >2013-12-09 12:44:36,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6316c02e >2013-12-09 12:44:36,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6316c02e >2013-12-09 12:44:36,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69913e73 >2013-12-09 12:44:36,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69913e73 >2013-12-09 12:44:41,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f486129 >2013-12-09 12:44:42,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f486129 >2013-12-09 12:44:42,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57ffd28e >2013-12-09 12:44:42,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57ffd28e >2013-12-09 12:44:47,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5550d0e5 >2013-12-09 12:44:48,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5550d0e5 >2013-12-09 12:44:48,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 204dd80 >2013-12-09 12:44:48,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 204dd80 >2013-12-09 12:44:53,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11ed183d >2013-12-09 12:44:53,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 11ed183d >2013-12-09 12:44:53,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 186bec4b >2013-12-09 12:44:54,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 186bec4b >2013-12-09 12:44:59,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55925708 >2013-12-09 12:44:59,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 55925708 >2013-12-09 12:44:59,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6060ce38 >2013-12-09 12:45:00,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6060ce38 >2013-12-09 12:45:05,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4cf7a22f >2013-12-09 12:45:05,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4cf7a22f >2013-12-09 12:45:05,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 297442ed >2013-12-09 12:45:05,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 297442ed >2013-12-09 12:45:10,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 232dfc54 >2013-12-09 12:45:11,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 232dfc54 >2013-12-09 12:45:11,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16010be >2013-12-09 12:45:11,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16010be >2013-12-09 12:45:16,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2657aee9 >2013-12-09 12:45:17,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2657aee9 >2013-12-09 12:45:17,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 574f847d >2013-12-09 12:45:17,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 574f847d >2013-12-09 12:45:22,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3be0c0ce >2013-12-09 12:45:22,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3be0c0ce >2013-12-09 12:45:22,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38ce330 >2013-12-09 12:45:23,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38ce330 >2013-12-09 12:45:28,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27b99fd1 >2013-12-09 12:45:28,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 27b99fd1 >2013-12-09 12:45:28,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 759cf9c >2013-12-09 12:45:28,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 759cf9c >2013-12-09 12:45:32,742 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-90) No up server in cluster >2013-12-09 12:45:32,742 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-90) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:45:32,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 456fea4d >2013-12-09 12:45:33,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterTasksListVDSCommand, return: [], log id: 456fea4d >2013-12-09 12:45:33,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ebff88b >2013-12-09 12:45:34,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ebff88b >2013-12-09 12:45:34,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7052cef2 >2013-12-09 12:45:34,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7052cef2 >2013-12-09 12:45:39,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45c3712d >2013-12-09 12:45:40,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 45c3712d >2013-12-09 12:45:40,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e28a271 >2013-12-09 12:45:40,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e28a271 >2013-12-09 12:45:45,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5bface3c >2013-12-09 12:45:45,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5bface3c >2013-12-09 12:45:46,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7fe39527 >2013-12-09 12:45:46,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fe39527 >2013-12-09 12:45:51,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b90a48 >2013-12-09 12:45:51,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b90a48 >2013-12-09 12:45:51,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e315069 >2013-12-09 12:45:52,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e315069 >2013-12-09 12:45:57,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2525fc57 >2013-12-09 12:45:57,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2525fc57 >2013-12-09 12:45:57,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7fd32cae >2013-12-09 12:45:57,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fd32cae >2013-12-09 12:46:02,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7cf952ab >2013-12-09 12:46:03,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7cf952ab >2013-12-09 12:46:03,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63a477ef >2013-12-09 12:46:03,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63a477ef >2013-12-09 12:46:08,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e2e2f2c >2013-12-09 12:46:09,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e2e2f2c >2013-12-09 12:46:09,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67cc9afb >2013-12-09 12:46:09,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67cc9afb >2013-12-09 12:46:14,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7fac1f22 >2013-12-09 12:46:14,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7fac1f22 >2013-12-09 12:46:14,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11d28063 >2013-12-09 12:46:15,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11d28063 >2013-12-09 12:46:20,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40011447 >2013-12-09 12:46:20,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 40011447 >2013-12-09 12:46:20,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a98292d >2013-12-09 12:46:20,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a98292d >2013-12-09 12:46:25,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d207b0c >2013-12-09 12:46:26,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d207b0c >2013-12-09 12:46:26,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 230680a5 >2013-12-09 12:46:26,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 230680a5 >2013-12-09 12:46:31,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51641fcd >2013-12-09 12:46:32,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 51641fcd >2013-12-09 12:46:32,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e48005c >2013-12-09 12:46:32,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e48005c >2013-12-09 12:46:33,025 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-77) No up server in cluster >2013-12-09 12:46:33,025 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-77) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:46:33,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8c232c5 >2013-12-09 12:46:33,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterTasksListVDSCommand, return: [], log id: 8c232c5 >2013-12-09 12:46:37,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f88abf8 >2013-12-09 12:46:38,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: f88abf8 >2013-12-09 12:46:38,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24866b17 >2013-12-09 12:46:38,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24866b17 >2013-12-09 12:46:43,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55b8d6c5 >2013-12-09 12:46:43,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 55b8d6c5 >2013-12-09 12:46:43,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25475ca1 >2013-12-09 12:46:44,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25475ca1 >2013-12-09 12:46:49,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 161f1f72 >2013-12-09 12:46:49,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 161f1f72 >2013-12-09 12:46:49,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b8f8524 >2013-12-09 12:46:49,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b8f8524 >2013-12-09 12:46:54,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a483575 >2013-12-09 12:46:55,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2a483575 >2013-12-09 12:46:55,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 220737d4 >2013-12-09 12:46:55,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 220737d4 >2013-12-09 12:47:00,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23d506dc >2013-12-09 12:47:01,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 23d506dc >2013-12-09 12:47:01,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 659c76b1 >2013-12-09 12:47:01,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 659c76b1 >2013-12-09 12:47:06,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67281537 >2013-12-09 12:47:06,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 67281537 >2013-12-09 12:47:06,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ba5092a >2013-12-09 12:47:07,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ba5092a >2013-12-09 12:47:12,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c9c97e2 >2013-12-09 12:47:12,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c9c97e2 >2013-12-09 12:47:12,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ccbc073 >2013-12-09 12:47:12,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ccbc073 >2013-12-09 12:47:17,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e3f5a84 >2013-12-09 12:47:18,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e3f5a84 >2013-12-09 12:47:18,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77544d32 >2013-12-09 12:47:18,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77544d32 >2013-12-09 12:47:23,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a6df5fe >2013-12-09 12:47:24,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a6df5fe >2013-12-09 12:47:24,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3416d097 >2013-12-09 12:47:24,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3416d097 >2013-12-09 12:47:29,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7cfa74e7 >2013-12-09 12:47:30,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7cfa74e7 >2013-12-09 12:47:30,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 586d139b >2013-12-09 12:47:30,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 586d139b >2013-12-09 12:47:33,304 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-69) No up server in cluster >2013-12-09 12:47:33,304 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-69) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:47:33,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7af7226b >2013-12-09 12:47:33,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7af7226b >2013-12-09 12:47:35,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4da481b4 >2013-12-09 12:47:35,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4da481b4 >2013-12-09 12:47:35,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6dfe469f >2013-12-09 12:47:36,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6dfe469f >2013-12-09 12:47:41,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28d12a64 >2013-12-09 12:47:41,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 28d12a64 >2013-12-09 12:47:41,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5aaaf3b7 >2013-12-09 12:47:41,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5aaaf3b7 >2013-12-09 12:47:46,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57ecdff0 >2013-12-09 12:47:47,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 57ecdff0 >2013-12-09 12:47:47,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7dadfdd4 >2013-12-09 12:47:47,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7dadfdd4 >2013-12-09 12:47:52,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 789e1eaf >2013-12-09 12:47:53,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 789e1eaf >2013-12-09 12:47:53,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31e385cf >2013-12-09 12:47:53,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31e385cf >2013-12-09 12:47:58,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51639f14 >2013-12-09 12:47:59,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 51639f14 >2013-12-09 12:47:59,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 599014d9 >2013-12-09 12:47:59,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 599014d9 >2013-12-09 12:48:04,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 791553cf >2013-12-09 12:48:04,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 791553cf >2013-12-09 12:48:04,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b826c93 >2013-12-09 12:48:05,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b826c93 >2013-12-09 12:48:10,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 739a9549 >2013-12-09 12:48:10,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 739a9549 >2013-12-09 12:48:10,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2da5e3b1 >2013-12-09 12:48:10,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2da5e3b1 >2013-12-09 12:48:15,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e6d814c >2013-12-09 12:48:16,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e6d814c >2013-12-09 12:48:16,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64806114 >2013-12-09 12:48:16,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64806114 >2013-12-09 12:48:21,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c0777a4 >2013-12-09 12:48:22,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c0777a4 >2013-12-09 12:48:22,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 139414f4 >2013-12-09 12:48:22,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 139414f4 >2013-12-09 12:48:27,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46d1885 >2013-12-09 12:48:27,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 46d1885 >2013-12-09 12:48:27,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ddc367d >2013-12-09 12:48:28,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ddc367d >2013-12-09 12:48:33,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d10b480 >2013-12-09 12:48:33,588 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) No up server in cluster >2013-12-09 12:48:33,588 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:48:33,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c407bbd >2013-12-09 12:48:33,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d10b480 >2013-12-09 12:48:33,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6cfd90f5 >2013-12-09 12:48:33,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterTasksListVDSCommand, return: [], log id: c407bbd >2013-12-09 12:48:33,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6cfd90f5 >2013-12-09 12:48:38,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7012e6a7 >2013-12-09 12:48:39,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7012e6a7 >2013-12-09 12:48:39,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c5a064f >2013-12-09 12:48:39,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c5a064f >2013-12-09 12:48:44,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: dc52305 >2013-12-09 12:48:45,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: dc52305 >2013-12-09 12:48:45,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ea881b >2013-12-09 12:48:45,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ea881b >2013-12-09 12:48:50,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a05a35f >2013-12-09 12:48:51,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a05a35f >2013-12-09 12:48:51,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 546e358e >2013-12-09 12:48:51,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 546e358e >2013-12-09 12:48:56,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36b66788 >2013-12-09 12:48:56,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 36b66788 >2013-12-09 12:48:56,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c381120 >2013-12-09 12:48:57,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c381120 >2013-12-09 12:49:02,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52ab3530 >2013-12-09 12:49:02,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 52ab3530 >2013-12-09 12:49:02,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a58d906 >2013-12-09 12:49:02,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a58d906 >2013-12-09 12:49:07,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71c492d9 >2013-12-09 12:49:08,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 71c492d9 >2013-12-09 12:49:08,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26c6177a >2013-12-09 12:49:08,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26c6177a >2013-12-09 12:49:13,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 719cd15f >2013-12-09 12:49:14,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 719cd15f >2013-12-09 12:49:14,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c66a7bd >2013-12-09 12:49:14,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c66a7bd >2013-12-09 12:49:19,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c095172 >2013-12-09 12:49:19,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c095172 >2013-12-09 12:49:19,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b24bb7d >2013-12-09 12:49:20,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b24bb7d >2013-12-09 12:49:25,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ef3c4fd >2013-12-09 12:49:25,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2ef3c4fd >2013-12-09 12:49:25,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c25b224 >2013-12-09 12:49:26,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c25b224 >2013-12-09 12:49:31,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4508c82b >2013-12-09 12:49:31,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4508c82b >2013-12-09 12:49:31,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9a7d538 >2013-12-09 12:49:31,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9a7d538 >2013-12-09 12:49:33,850 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) No up server in cluster >2013-12-09 12:49:33,850 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:49:33,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16ac9cf9 >2013-12-09 12:49:34,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterTasksListVDSCommand, return: [], log id: 16ac9cf9 >2013-12-09 12:49:36,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 112f8e4d >2013-12-09 12:49:37,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 112f8e4d >2013-12-09 12:49:37,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74a13f19 >2013-12-09 12:49:37,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74a13f19 >2013-12-09 12:49:42,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79918dde >2013-12-09 12:49:43,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 79918dde >2013-12-09 12:49:43,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5cd83c3e >2013-12-09 12:49:43,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cd83c3e >2013-12-09 12:49:48,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52632ae4 >2013-12-09 12:49:48,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 52632ae4 >2013-12-09 12:49:48,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48898432 >2013-12-09 12:49:49,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48898432 >2013-12-09 12:49:54,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: deaf99b >2013-12-09 12:49:54,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: deaf99b >2013-12-09 12:49:54,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ce1c934 >2013-12-09 12:49:54,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ce1c934 >2013-12-09 12:49:59,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9ac6af2 >2013-12-09 12:50:00,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 9ac6af2 >2013-12-09 12:50:00,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38b56969 >2013-12-09 12:50:00,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38b56969 >2013-12-09 12:50:05,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26071a4f >2013-12-09 12:50:06,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 26071a4f >2013-12-09 12:50:06,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 300879a9 >2013-12-09 12:50:06,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 300879a9 >2013-12-09 12:50:11,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3640f34f >2013-12-09 12:50:12,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3640f34f >2013-12-09 12:50:12,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f1aa920 >2013-12-09 12:50:12,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f1aa920 >2013-12-09 12:50:17,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1bfeca3c >2013-12-09 12:50:17,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1bfeca3c >2013-12-09 12:50:17,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73668373 >2013-12-09 12:50:18,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73668373 >2013-12-09 12:50:23,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13e5c67d >2013-12-09 12:50:23,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 13e5c67d >2013-12-09 12:50:23,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56b6cb80 >2013-12-09 12:50:23,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56b6cb80 >2013-12-09 12:50:28,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ce37b7e >2013-12-09 12:50:29,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3ce37b7e >2013-12-09 12:50:29,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1fa532ff >2013-12-09 12:50:29,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1fa532ff >2013-12-09 12:50:34,129 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-6) No up server in cluster >2013-12-09 12:50:34,129 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-6) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:50:34,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e9b1cec >2013-12-09 12:50:34,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2e9b1cec >2013-12-09 12:50:34,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 300a8627 >2013-12-09 12:50:35,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 300a8627 >2013-12-09 12:50:35,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 127f3211 >2013-12-09 12:50:35,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 127f3211 >2013-12-09 12:50:40,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bd02de7 >2013-12-09 12:50:40,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1bd02de7 >2013-12-09 12:50:40,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e98869f >2013-12-09 12:50:41,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e98869f >2013-12-09 12:50:46,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e8a82d2 >2013-12-09 12:50:46,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e8a82d2 >2013-12-09 12:50:46,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a72091c >2013-12-09 12:50:46,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a72091c >2013-12-09 12:50:51,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a73e49f >2013-12-09 12:50:52,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a73e49f >2013-12-09 12:50:52,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75bee6f9 >2013-12-09 12:50:52,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75bee6f9 >2013-12-09 12:50:57,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2985cf2f >2013-12-09 12:50:58,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2985cf2f >2013-12-09 12:50:58,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e67a897 >2013-12-09 12:50:58,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e67a897 >2013-12-09 12:51:03,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b17de27 >2013-12-09 12:51:03,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b17de27 >2013-12-09 12:51:03,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ab058fb >2013-12-09 12:51:04,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ab058fb >2013-12-09 12:51:09,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 106d3b5d >2013-12-09 12:51:09,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 106d3b5d >2013-12-09 12:51:09,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77b6e8aa >2013-12-09 12:51:10,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77b6e8aa >2013-12-09 12:51:15,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 764fa561 >2013-12-09 12:51:15,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 764fa561 >2013-12-09 12:51:15,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c43e7f3 >2013-12-09 12:51:15,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c43e7f3 >2013-12-09 12:51:20,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 402274a8 >2013-12-09 12:51:21,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 402274a8 >2013-12-09 12:51:21,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63c1ed49 >2013-12-09 12:51:21,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63c1ed49 >2013-12-09 12:51:26,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67dbe6f2 >2013-12-09 12:51:27,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 67dbe6f2 >2013-12-09 12:51:27,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a8255a0 >2013-12-09 12:51:27,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a8255a0 >2013-12-09 12:51:32,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 260fae45 >2013-12-09 12:51:32,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 260fae45 >2013-12-09 12:51:32,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73be4245 >2013-12-09 12:51:33,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73be4245 >2013-12-09 12:51:34,407 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-45) No up server in cluster >2013-12-09 12:51:34,407 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-45) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:51:34,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71f19c71 >2013-12-09 12:51:34,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterTasksListVDSCommand, return: [], log id: 71f19c71 >2013-12-09 12:51:38,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9d40f95 >2013-12-09 12:51:38,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 9d40f95 >2013-12-09 12:51:38,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55ff0b0e >2013-12-09 12:51:38,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55ff0b0e >2013-12-09 12:51:43,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 689e9807 >2013-12-09 12:51:44,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 689e9807 >2013-12-09 12:51:44,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b1256ed >2013-12-09 12:51:44,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b1256ed >2013-12-09 12:51:49,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47ddb7aa >2013-12-09 12:51:50,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 47ddb7aa >2013-12-09 12:51:50,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a31d60 >2013-12-09 12:51:50,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a31d60 >2013-12-09 12:51:55,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 670c9011 >2013-12-09 12:51:55,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 670c9011 >2013-12-09 12:51:55,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72ce50a9 >2013-12-09 12:51:56,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72ce50a9 >2013-12-09 12:52:01,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 25858008 >2013-12-09 12:52:01,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 25858008 >2013-12-09 12:52:01,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a5a5ef2 >2013-12-09 12:52:01,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a5a5ef2 >2013-12-09 12:52:07,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8d9c21 >2013-12-09 12:52:07,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 8d9c21 >2013-12-09 12:52:07,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3db0d688 >2013-12-09 12:52:07,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3db0d688 >2013-12-09 12:52:12,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24ac4fb0 >2013-12-09 12:52:13,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 24ac4fb0 >2013-12-09 12:52:13,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3819e807 >2013-12-09 12:52:13,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3819e807 >2013-12-09 12:52:18,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ed9c7b5 >2013-12-09 12:52:19,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ed9c7b5 >2013-12-09 12:52:19,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e69e52c >2013-12-09 12:52:19,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e69e52c >2013-12-09 12:52:24,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3074f73f >2013-12-09 12:52:24,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3074f73f >2013-12-09 12:52:24,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41b22f4d >2013-12-09 12:52:25,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41b22f4d >2013-12-09 12:52:30,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c81e270 >2013-12-09 12:52:30,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4c81e270 >2013-12-09 12:52:30,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ed4220e >2013-12-09 12:52:30,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ed4220e >2013-12-09 12:52:34,680 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-97) No up server in cluster >2013-12-09 12:52:34,680 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-97) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:52:34,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b1990f >2013-12-09 12:52:34,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterTasksListVDSCommand, return: [], log id: b1990f >2013-12-09 12:52:35,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69274d84 >2013-12-09 12:52:36,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 69274d84 >2013-12-09 12:52:36,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51d9a6ff >2013-12-09 12:52:36,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51d9a6ff >2013-12-09 12:52:41,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a8b1b4b >2013-12-09 12:52:42,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a8b1b4b >2013-12-09 12:52:42,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f308a6a >2013-12-09 12:52:42,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f308a6a >2013-12-09 12:52:47,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 22a8b2b0 >2013-12-09 12:52:47,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 22a8b2b0 >2013-12-09 12:52:47,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3480469f >2013-12-09 12:52:48,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3480469f >2013-12-09 12:52:53,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46130a02 >2013-12-09 12:52:53,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 46130a02 >2013-12-09 12:52:53,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78a988a7 >2013-12-09 12:52:53,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78a988a7 >2013-12-09 12:52:58,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f4a613f >2013-12-09 12:52:59,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f4a613f >2013-12-09 12:52:59,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 28b297e1 >2013-12-09 12:52:59,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28b297e1 >2013-12-09 12:53:04,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b574361 >2013-12-09 12:53:05,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b574361 >2013-12-09 12:53:05,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ab9f4c5 >2013-12-09 12:53:05,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ab9f4c5 >2013-12-09 12:53:10,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4537ab0b >2013-12-09 12:53:11,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4537ab0b >2013-12-09 12:53:11,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 212910fa >2013-12-09 12:53:11,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 212910fa >2013-12-09 12:53:16,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d965558 >2013-12-09 12:53:16,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d965558 >2013-12-09 12:53:16,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 761c8bb3 >2013-12-09 12:53:17,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 761c8bb3 >2013-12-09 12:53:22,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d55247d >2013-12-09 12:53:22,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4d55247d >2013-12-09 12:53:22,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a8a2d35 >2013-12-09 12:53:23,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a8a2d35 >2013-12-09 12:53:28,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3007f069 >2013-12-09 12:53:28,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3007f069 >2013-12-09 12:53:28,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 114de0e0 >2013-12-09 12:53:28,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 114de0e0 >2013-12-09 12:53:33,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d5f8e1 >2013-12-09 12:53:34,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d5f8e1 >2013-12-09 12:53:34,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 551a5d75 >2013-12-09 12:53:34,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 551a5d75 >2013-12-09 12:53:34,955 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-16) No up server in cluster >2013-12-09 12:53:34,955 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-16) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:53:34,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67294c58 >2013-12-09 12:53:35,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterTasksListVDSCommand, return: [], log id: 67294c58 >2013-12-09 12:53:39,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1fc0b542 >2013-12-09 12:53:40,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1fc0b542 >2013-12-09 12:53:40,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62573fec >2013-12-09 12:53:40,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62573fec >2013-12-09 12:53:45,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4fac226d >2013-12-09 12:53:45,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4fac226d >2013-12-09 12:53:45,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1869021c >2013-12-09 12:53:46,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1869021c >2013-12-09 12:53:51,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36e5c85e >2013-12-09 12:53:51,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 36e5c85e >2013-12-09 12:53:51,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72881e9 >2013-12-09 12:53:52,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72881e9 >2013-12-09 12:53:57,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36e8c928 >2013-12-09 12:53:57,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 36e8c928 >2013-12-09 12:53:57,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 303b8480 >2013-12-09 12:53:57,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 303b8480 >2013-12-09 12:54:02,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12003f2b >2013-12-09 12:54:03,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 12003f2b >2013-12-09 12:54:03,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 706ef794 >2013-12-09 12:54:03,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 706ef794 >2013-12-09 12:54:08,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e3b273e >2013-12-09 12:54:09,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7e3b273e >2013-12-09 12:54:09,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 501c842a >2013-12-09 12:54:09,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 501c842a >2013-12-09 12:54:14,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59762a7f >2013-12-09 12:54:14,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59762a7f >2013-12-09 12:54:14,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 572f421d >2013-12-09 12:54:15,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 572f421d >2013-12-09 12:54:20,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2aa6c0b2 >2013-12-09 12:54:20,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2aa6c0b2 >2013-12-09 12:54:20,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47106bc5 >2013-12-09 12:54:20,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47106bc5 >2013-12-09 12:54:25,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36ef8e20 >2013-12-09 12:54:26,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 36ef8e20 >2013-12-09 12:54:26,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72464d35 >2013-12-09 12:54:26,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72464d35 >2013-12-09 12:54:31,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 886b207 >2013-12-09 12:54:32,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 886b207 >2013-12-09 12:54:32,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 656d3008 >2013-12-09 12:54:32,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 656d3008 >2013-12-09 12:54:35,244 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-82) No up server in cluster >2013-12-09 12:54:35,244 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-82) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:54:35,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a42151a >2013-12-09 12:54:35,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2a42151a >2013-12-09 12:54:37,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b5fbae5 >2013-12-09 12:54:37,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b5fbae5 >2013-12-09 12:54:37,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3bbbe16f >2013-12-09 12:54:38,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3bbbe16f >2013-12-09 12:54:43,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37428b70 >2013-12-09 12:54:43,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 37428b70 >2013-12-09 12:54:43,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d14ec9f >2013-12-09 12:54:43,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d14ec9f >2013-12-09 12:54:48,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: aea6b04 >2013-12-09 12:54:49,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: aea6b04 >2013-12-09 12:54:49,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f70bc63 >2013-12-09 12:54:49,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f70bc63 >2013-12-09 12:54:54,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56d1efcc >2013-12-09 12:54:55,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 56d1efcc >2013-12-09 12:54:55,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21ae48ba >2013-12-09 12:54:55,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21ae48ba >2013-12-09 12:55:00,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6258b66a >2013-12-09 12:55:01,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6258b66a >2013-12-09 12:55:01,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 780d1bc8 >2013-12-09 12:55:01,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 780d1bc8 >2013-12-09 12:55:06,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 28c442a1 >2013-12-09 12:55:06,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 28c442a1 >2013-12-09 12:55:06,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 514133 >2013-12-09 12:55:07,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 514133 >2013-12-09 12:55:12,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46d13be6 >2013-12-09 12:55:12,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 46d13be6 >2013-12-09 12:55:12,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 14cac4 >2013-12-09 12:55:12,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14cac4 >2013-12-09 12:55:17,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5520933 >2013-12-09 12:55:18,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5520933 >2013-12-09 12:55:18,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76a62e >2013-12-09 12:55:18,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76a62e >2013-12-09 12:55:23,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7259dd31 >2013-12-09 12:55:24,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7259dd31 >2013-12-09 12:55:24,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31c25e5c >2013-12-09 12:55:24,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31c25e5c >2013-12-09 12:55:29,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 14421b2d >2013-12-09 12:55:29,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 14421b2d >2013-12-09 12:55:29,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7124b2e >2013-12-09 12:55:30,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7124b2e >2013-12-09 12:55:35,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 522518c2 >2013-12-09 12:55:35,529 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-44) No up server in cluster >2013-12-09 12:55:35,529 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-44) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:55:35,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ec3a174 >2013-12-09 12:55:35,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 522518c2 >2013-12-09 12:55:35,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 466eabad >2013-12-09 12:55:35,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1ec3a174 >2013-12-09 12:55:35,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 466eabad >2013-12-09 12:55:40,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55b4a5aa >2013-12-09 12:55:41,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 55b4a5aa >2013-12-09 12:55:41,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10f0407c >2013-12-09 12:55:41,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10f0407c >2013-12-09 12:55:46,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a9174e9 >2013-12-09 12:55:47,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: a9174e9 >2013-12-09 12:55:47,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a1321b9 >2013-12-09 12:55:47,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a1321b9 >2013-12-09 12:55:52,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e718b85 >2013-12-09 12:55:53,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6e718b85 >2013-12-09 12:55:53,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55dc8674 >2013-12-09 12:55:53,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55dc8674 >2013-12-09 12:55:58,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4726a9a7 >2013-12-09 12:55:58,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4726a9a7 >2013-12-09 12:55:58,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 263e01cf >2013-12-09 12:55:59,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 263e01cf >2013-12-09 12:56:04,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a001ff7 >2013-12-09 12:56:04,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: a001ff7 >2013-12-09 12:56:04,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2630600d >2013-12-09 12:56:04,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2630600d >2013-12-09 12:56:09,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3cea0cae >2013-12-09 12:56:10,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3cea0cae >2013-12-09 12:56:10,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1eb74889 >2013-12-09 12:56:10,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1eb74889 >2013-12-09 12:56:15,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64656dae >2013-12-09 12:56:16,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 64656dae >2013-12-09 12:56:16,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40d1363a >2013-12-09 12:56:16,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40d1363a >2013-12-09 12:56:21,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: af2569a >2013-12-09 12:56:21,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: af2569a >2013-12-09 12:56:21,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f21c7b2 >2013-12-09 12:56:22,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f21c7b2 >2013-12-09 12:56:27,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 80ebe77 >2013-12-09 12:56:27,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 80ebe77 >2013-12-09 12:56:27,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42d2e07 >2013-12-09 12:56:27,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42d2e07 >2013-12-09 12:56:32,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31ce6a04 >2013-12-09 12:56:33,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 31ce6a04 >2013-12-09 12:56:33,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29dbabe8 >2013-12-09 12:56:33,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29dbabe8 >2013-12-09 12:56:35,799 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-5) No up server in cluster >2013-12-09 12:56:35,799 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-5) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:56:35,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e1ae60d >2013-12-09 12:56:36,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2e1ae60d >2013-12-09 12:56:38,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49634965 >2013-12-09 12:56:39,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 49634965 >2013-12-09 12:56:39,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c4eff4a >2013-12-09 12:56:39,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c4eff4a >2013-12-09 12:56:44,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78f39a45 >2013-12-09 12:56:45,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 78f39a45 >2013-12-09 12:56:45,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7eff05c >2013-12-09 12:56:45,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7eff05c >2013-12-09 12:56:50,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12c08fa4 >2013-12-09 12:56:50,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 12c08fa4 >2013-12-09 12:56:50,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67819d34 >2013-12-09 12:56:51,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67819d34 >2013-12-09 12:56:56,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 668747ca >2013-12-09 12:56:56,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 668747ca >2013-12-09 12:56:56,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e1e3124 >2013-12-09 12:56:56,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e1e3124 >2013-12-09 12:57:01,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5dd15ccd >2013-12-09 12:57:02,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5dd15ccd >2013-12-09 12:57:02,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 787cc278 >2013-12-09 12:57:02,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 787cc278 >2013-12-09 12:57:07,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 562f4c4 >2013-12-09 12:57:08,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 562f4c4 >2013-12-09 12:57:08,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1097ce97 >2013-12-09 12:57:08,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1097ce97 >2013-12-09 12:57:13,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2636400c >2013-12-09 12:57:13,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2636400c >2013-12-09 12:57:13,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16b8d9f2 >2013-12-09 12:57:14,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16b8d9f2 >2013-12-09 12:57:19,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e55611f >2013-12-09 12:57:19,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e55611f >2013-12-09 12:57:19,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42b9716 >2013-12-09 12:57:19,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42b9716 >2013-12-09 12:57:24,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f4c6744 >2013-12-09 12:57:25,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1f4c6744 >2013-12-09 12:57:25,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c694266 >2013-12-09 12:57:25,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c694266 >2013-12-09 12:57:30,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f02422b >2013-12-09 12:57:31,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: f02422b >2013-12-09 12:57:31,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b49e7d8 >2013-12-09 12:57:31,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b49e7d8 >2013-12-09 12:57:36,077 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) No up server in cluster >2013-12-09 12:57:36,077 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:57:36,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69c50bbc >2013-12-09 12:57:36,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterTasksListVDSCommand, return: [], log id: 69c50bbc >2013-12-09 12:57:36,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a197d52 >2013-12-09 12:57:36,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3a197d52 >2013-12-09 12:57:36,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20250e41 >2013-12-09 12:57:37,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20250e41 >2013-12-09 12:57:42,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 677e9c04 >2013-12-09 12:57:42,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 677e9c04 >2013-12-09 12:57:42,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ad14ff2 >2013-12-09 12:57:42,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ad14ff2 >2013-12-09 12:57:48,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c786a34 >2013-12-09 12:57:48,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7c786a34 >2013-12-09 12:57:48,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b8832d7 >2013-12-09 12:57:48,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b8832d7 >2013-12-09 12:57:53,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67e61d9c >2013-12-09 12:57:54,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 67e61d9c >2013-12-09 12:57:54,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 314dd47d >2013-12-09 12:57:54,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 314dd47d >2013-12-09 12:57:59,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63b2a69e >2013-12-09 12:58:00,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 63b2a69e >2013-12-09 12:58:00,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ff2b6f3 >2013-12-09 12:58:00,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ff2b6f3 >2013-12-09 12:58:05,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b280ad0 >2013-12-09 12:58:05,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: b280ad0 >2013-12-09 12:58:05,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 508c7cf4 >2013-12-09 12:58:06,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 508c7cf4 >2013-12-09 12:58:11,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1bdb9d9d >2013-12-09 12:58:11,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1bdb9d9d >2013-12-09 12:58:11,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d22bb12 >2013-12-09 12:58:11,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d22bb12 >2013-12-09 12:58:16,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55f79cf9 >2013-12-09 12:58:17,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 55f79cf9 >2013-12-09 12:58:17,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67cd4354 >2013-12-09 12:58:17,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67cd4354 >2013-12-09 12:58:22,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73acd313 >2013-12-09 12:58:23,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 73acd313 >2013-12-09 12:58:23,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7792ae44 >2013-12-09 12:58:23,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7792ae44 >2013-12-09 12:58:28,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b6ed140 >2013-12-09 12:58:29,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b6ed140 >2013-12-09 12:58:29,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20271ec5 >2013-12-09 12:58:29,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20271ec5 >2013-12-09 12:58:34,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 130a7e0b >2013-12-09 12:58:34,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 130a7e0b >2013-12-09 12:58:34,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e6b3cc7 >2013-12-09 12:58:35,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e6b3cc7 >2013-12-09 12:58:36,367 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) No up server in cluster >2013-12-09 12:58:36,368 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:58:36,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40ac71a5 >2013-12-09 12:58:36,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterTasksListVDSCommand, return: [], log id: 40ac71a5 >2013-12-09 12:58:40,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f5033a8 >2013-12-09 12:58:40,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f5033a8 >2013-12-09 12:58:40,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 15b05afb >2013-12-09 12:58:40,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15b05afb >2013-12-09 12:58:45,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10bd5a37 >2013-12-09 12:58:46,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 10bd5a37 >2013-12-09 12:58:46,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11c92eca >2013-12-09 12:58:46,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11c92eca >2013-12-09 12:58:51,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71f2f87d >2013-12-09 12:58:52,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 71f2f87d >2013-12-09 12:58:52,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35dbc84e >2013-12-09 12:58:52,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35dbc84e >2013-12-09 12:58:57,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6fe24461 >2013-12-09 12:58:57,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6fe24461 >2013-12-09 12:58:57,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23530bdb >2013-12-09 12:58:58,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23530bdb >2013-12-09 12:59:03,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 28e3a00d >2013-12-09 12:59:03,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 28e3a00d >2013-12-09 12:59:03,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: fa89798 >2013-12-09 12:59:03,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: fa89798 >2013-12-09 12:59:08,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 44debde5 >2013-12-09 12:59:09,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 44debde5 >2013-12-09 12:59:09,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42d11117 >2013-12-09 12:59:09,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42d11117 >2013-12-09 12:59:14,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33c998d1 >2013-12-09 12:59:15,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 33c998d1 >2013-12-09 12:59:15,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 774b74e5 >2013-12-09 12:59:15,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 774b74e5 >2013-12-09 12:59:20,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41d56ec0 >2013-12-09 12:59:21,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 41d56ec0 >2013-12-09 12:59:21,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13761863 >2013-12-09 12:59:21,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13761863 >2013-12-09 12:59:26,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 499785d6 >2013-12-09 12:59:26,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 499785d6 >2013-12-09 12:59:26,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c8bc467 >2013-12-09 12:59:27,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c8bc467 >2013-12-09 12:59:32,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75f8f956 >2013-12-09 12:59:32,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 75f8f956 >2013-12-09 12:59:32,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69265c59 >2013-12-09 12:59:32,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69265c59 >2013-12-09 12:59:36,656 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-24) No up server in cluster >2013-12-09 12:59:36,656 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-24) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 12:59:36,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6330752c >2013-12-09 12:59:36,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6330752c >2013-12-09 12:59:37,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 676aff70 >2013-12-09 12:59:38,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 676aff70 >2013-12-09 12:59:38,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f05b7cb >2013-12-09 12:59:38,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f05b7cb >2013-12-09 12:59:38,749 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update VMs/Templates Ovf. >2013-12-09 12:59:40,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-46) START, GlusterHooksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a49df75 >2013-12-09 12:59:40,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-48) START, GlusterHooksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c8e2d73 >2013-12-09 12:59:40,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-46) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@f5ad7c98, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@6c75ef3e, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@d7706825, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@660c1d6, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@91094dfb, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@47def54d, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@4aa19183], log id: 4a49df75 >2013-12-09 12:59:40,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-48) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@bb6fc9e5, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@61dea838, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@18b4fef8, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@669ff803, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@be63597c, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@2f379c35, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@cc4e2984], log id: c8e2d73 >2013-12-09 12:59:42,015 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-9) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-09 12:59:42,018 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp-/127.0.0.1:8702-6) [317278f9] Running command: LogoutUserCommand internal: false. >2013-12-09 12:59:42,039 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [317278f9] Correlation ID: 317278f9, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged out. >2013-12-09 12:59:43,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 420105f1 >2013-12-09 12:59:44,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 420105f1 >2013-12-09 12:59:44,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 717c148a >2013-12-09 12:59:44,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 717c148a >2013-12-09 12:59:44,616 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-69) Start refreshing all users data >2013-12-09 12:59:49,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b401cce >2013-12-09 12:59:49,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1b401cce >2013-12-09 12:59:49,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4291250a >2013-12-09 12:59:50,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4291250a >2013-12-09 12:59:55,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c65d97a >2013-12-09 12:59:55,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c65d97a >2013-12-09 12:59:55,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6198e6f1 >2013-12-09 12:59:55,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6198e6f1 >2013-12-09 13:00:00,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19d73fc >2013-12-09 13:00:01,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19d73fc >2013-12-09 13:00:01,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3591a0b2 >2013-12-09 13:00:01,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3591a0b2 >2013-12-09 13:00:06,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a38ad6d >2013-12-09 13:00:07,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: a38ad6d >2013-12-09 13:00:07,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16945513 >2013-12-09 13:00:07,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16945513 >2013-12-09 13:00:12,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45a75c1 >2013-12-09 13:00:13,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 45a75c1 >2013-12-09 13:00:13,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57e082f >2013-12-09 13:00:13,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57e082f >2013-12-09 13:00:18,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 100a82b2 >2013-12-09 13:00:18,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 100a82b2 >2013-12-09 13:00:18,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b0797a0 >2013-12-09 13:00:19,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b0797a0 >2013-12-09 13:00:24,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 113995c0 >2013-12-09 13:00:24,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 113995c0 >2013-12-09 13:00:24,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d159b58 >2013-12-09 13:00:24,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d159b58 >2013-12-09 13:00:29,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67815f52 >2013-12-09 13:00:30,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 67815f52 >2013-12-09 13:00:30,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36addb85 >2013-12-09 13:00:30,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36addb85 >2013-12-09 13:00:35,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e1a5b3a >2013-12-09 13:00:36,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2e1a5b3a >2013-12-09 13:00:36,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f355118 >2013-12-09 13:00:36,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f355118 >2013-12-09 13:00:36,934 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-12) No up server in cluster >2013-12-09 13:00:36,935 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-12) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:00:36,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76666b04 >2013-12-09 13:00:37,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterTasksListVDSCommand, return: [], log id: 76666b04 >2013-12-09 13:00:41,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7fa3cf76 >2013-12-09 13:00:41,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7fa3cf76 >2013-12-09 13:00:41,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c69178a >2013-12-09 13:00:42,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c69178a >2013-12-09 13:00:47,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 434c52ce >2013-12-09 13:00:47,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 434c52ce >2013-12-09 13:00:47,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c1f50fe >2013-12-09 13:00:47,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c1f50fe >2013-12-09 13:00:52,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 492ed292 >2013-12-09 13:00:53,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 492ed292 >2013-12-09 13:00:53,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 464eec21 >2013-12-09 13:00:53,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 464eec21 >2013-12-09 13:00:58,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c1675e >2013-12-09 13:00:59,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7c1675e >2013-12-09 13:00:59,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c414d6e >2013-12-09 13:00:59,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c414d6e >2013-12-09 13:01:04,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57381d7f >2013-12-09 13:01:05,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 57381d7f >2013-12-09 13:01:05,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 408005cb >2013-12-09 13:01:05,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 408005cb >2013-12-09 13:01:10,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5128b536 >2013-12-09 13:01:10,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5128b536 >2013-12-09 13:01:10,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16a7811a >2013-12-09 13:01:11,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16a7811a >2013-12-09 13:01:16,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e167024 >2013-12-09 13:01:16,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: e167024 >2013-12-09 13:01:16,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e43f1e5 >2013-12-09 13:01:16,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e43f1e5 >2013-12-09 13:01:21,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 482b2934 >2013-12-09 13:01:22,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 482b2934 >2013-12-09 13:01:22,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e226664 >2013-12-09 13:01:22,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e226664 >2013-12-09 13:01:27,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c4e3424 >2013-12-09 13:01:28,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2c4e3424 >2013-12-09 13:01:28,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58cfb8fd >2013-12-09 13:01:28,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58cfb8fd >2013-12-09 13:01:33,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 775fb590 >2013-12-09 13:01:33,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 775fb590 >2013-12-09 13:01:33,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1673cdc0 >2013-12-09 13:01:34,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1673cdc0 >2013-12-09 13:01:37,219 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-92) No up server in cluster >2013-12-09 13:01:37,219 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-92) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:01:37,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5660eec6 >2013-12-09 13:01:37,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5660eec6 >2013-12-09 13:01:39,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ee0eddb >2013-12-09 13:01:39,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ee0eddb >2013-12-09 13:01:39,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63f332a3 >2013-12-09 13:01:39,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63f332a3 >2013-12-09 13:01:44,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 699c9f71 >2013-12-09 13:01:45,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 699c9f71 >2013-12-09 13:01:45,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 44b4a971 >2013-12-09 13:01:45,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44b4a971 >2013-12-09 13:01:50,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 362fd8d3 >2013-12-09 13:01:51,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 362fd8d3 >2013-12-09 13:01:51,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a996e2b >2013-12-09 13:01:51,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a996e2b >2013-12-09 13:01:56,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7019b5bf >2013-12-09 13:01:57,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7019b5bf >2013-12-09 13:01:57,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3eb63220 >2013-12-09 13:01:57,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3eb63220 >2013-12-09 13:02:02,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 498f648b >2013-12-09 13:02:02,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 498f648b >2013-12-09 13:02:02,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2880fb7a >2013-12-09 13:02:03,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2880fb7a >2013-12-09 13:02:08,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15dec4b9 >2013-12-09 13:02:08,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 15dec4b9 >2013-12-09 13:02:08,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 22d2a3d3 >2013-12-09 13:02:08,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22d2a3d3 >2013-12-09 13:02:13,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45fd32d2 >2013-12-09 13:02:14,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 45fd32d2 >2013-12-09 13:02:14,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2aa8cbd >2013-12-09 13:02:14,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2aa8cbd >2013-12-09 13:02:19,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70f47e3c >2013-12-09 13:02:20,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 70f47e3c >2013-12-09 13:02:20,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ce54f32 >2013-12-09 13:02:20,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ce54f32 >2013-12-09 13:02:25,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e5b276b >2013-12-09 13:02:25,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e5b276b >2013-12-09 13:02:25,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11410d2 >2013-12-09 13:02:26,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11410d2 >2013-12-09 13:02:31,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31f88282 >2013-12-09 13:02:31,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 31f88282 >2013-12-09 13:02:31,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21c65a84 >2013-12-09 13:02:31,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21c65a84 >2013-12-09 13:02:36,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 679a7612 >2013-12-09 13:02:37,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 679a7612 >2013-12-09 13:02:37,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42972353 >2013-12-09 13:02:37,506 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-76) No up server in cluster >2013-12-09 13:02:37,506 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-76) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:02:37,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 759fbc1a >2013-12-09 13:02:37,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42972353 >2013-12-09 13:02:37,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterTasksListVDSCommand, return: [], log id: 759fbc1a >2013-12-09 13:02:42,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ec7333e >2013-12-09 13:02:43,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2ec7333e >2013-12-09 13:02:43,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 288416 >2013-12-09 13:02:43,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 288416 >2013-12-09 13:02:48,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4aaf0fcd >2013-12-09 13:02:49,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4aaf0fcd >2013-12-09 13:02:49,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63096828 >2013-12-09 13:02:49,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63096828 >2013-12-09 13:02:54,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f5d83bc >2013-12-09 13:02:54,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: f5d83bc >2013-12-09 13:02:54,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a77e013 >2013-12-09 13:02:55,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a77e013 >2013-12-09 13:03:00,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6528182e >2013-12-09 13:03:00,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6528182e >2013-12-09 13:03:00,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b74e316 >2013-12-09 13:03:00,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b74e316 >2013-12-09 13:03:05,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5279fac >2013-12-09 13:03:06,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5279fac >2013-12-09 13:03:06,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58a9f9d3 >2013-12-09 13:03:06,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58a9f9d3 >2013-12-09 13:03:11,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69067311 >2013-12-09 13:03:12,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 69067311 >2013-12-09 13:03:12,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75fcad9e >2013-12-09 13:03:12,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75fcad9e >2013-12-09 13:03:17,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1604a561 >2013-12-09 13:03:17,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1604a561 >2013-12-09 13:03:17,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44bd5f9f >2013-12-09 13:03:18,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44bd5f9f >2013-12-09 13:03:23,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f15e10b >2013-12-09 13:03:23,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5f15e10b >2013-12-09 13:03:23,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6289323e >2013-12-09 13:03:24,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6289323e >2013-12-09 13:03:29,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 791d9cee >2013-12-09 13:03:29,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 791d9cee >2013-12-09 13:03:29,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e7a18a0 >2013-12-09 13:03:29,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e7a18a0 >2013-12-09 13:03:34,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d6f2441 >2013-12-09 13:03:35,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2d6f2441 >2013-12-09 13:03:35,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21a772f >2013-12-09 13:03:35,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21a772f >2013-12-09 13:03:37,773 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-37) No up server in cluster >2013-12-09 13:03:37,773 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-37) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:03:37,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e3c26b4 >2013-12-09 13:03:38,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5e3c26b4 >2013-12-09 13:03:40,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 476f5e64 >2013-12-09 13:03:41,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 476f5e64 >2013-12-09 13:03:41,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70ce06ec >2013-12-09 13:03:41,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70ce06ec >2013-12-09 13:03:46,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9fc37b4 >2013-12-09 13:03:46,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 9fc37b4 >2013-12-09 13:03:46,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5660d86a >2013-12-09 13:03:47,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5660d86a >2013-12-09 13:03:52,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 14f2e92f >2013-12-09 13:03:52,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 14f2e92f >2013-12-09 13:03:52,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79f14c6b >2013-12-09 13:03:52,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79f14c6b >2013-12-09 13:03:57,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 525b7660 >2013-12-09 13:03:58,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 525b7660 >2013-12-09 13:03:58,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75d6aae1 >2013-12-09 13:03:58,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75d6aae1 >2013-12-09 13:04:03,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d988a22 >2013-12-09 13:04:04,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: d988a22 >2013-12-09 13:04:04,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5187508b >2013-12-09 13:04:04,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5187508b >2013-12-09 13:04:09,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50aa6c23 >2013-12-09 13:04:10,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 50aa6c23 >2013-12-09 13:04:10,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68410b16 >2013-12-09 13:04:10,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68410b16 >2013-12-09 13:04:15,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2629e851 >2013-12-09 13:04:15,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2629e851 >2013-12-09 13:04:15,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c4a8b8c >2013-12-09 13:04:16,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c4a8b8c >2013-12-09 13:04:21,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75499452 >2013-12-09 13:04:21,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 75499452 >2013-12-09 13:04:21,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 348e1e55 >2013-12-09 13:04:21,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 348e1e55 >2013-12-09 13:04:26,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: de18684 >2013-12-09 13:04:27,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: de18684 >2013-12-09 13:04:27,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59e87ebd >2013-12-09 13:04:27,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59e87ebd >2013-12-09 13:04:32,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40fa97b4 >2013-12-09 13:04:33,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 40fa97b4 >2013-12-09 13:04:33,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e738f01 >2013-12-09 13:04:33,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e738f01 >2013-12-09 13:04:38,060 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-80) No up server in cluster >2013-12-09 13:04:38,060 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-80) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:04:38,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1fd97abb >2013-12-09 13:04:38,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1fd97abb >2013-12-09 13:04:38,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b62ea96 >2013-12-09 13:04:38,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4b62ea96 >2013-12-09 13:04:38,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f9767b >2013-12-09 13:04:39,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f9767b >2013-12-09 13:04:44,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7bd1e3b8 >2013-12-09 13:04:44,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7bd1e3b8 >2013-12-09 13:04:44,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 498751a5 >2013-12-09 13:04:45,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 498751a5 >2013-12-09 13:04:50,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e61ef7c >2013-12-09 13:04:50,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e61ef7c >2013-12-09 13:04:50,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31cf7622 >2013-12-09 13:04:50,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31cf7622 >2013-12-09 13:04:55,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 344d4561 >2013-12-09 13:04:56,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 344d4561 >2013-12-09 13:04:56,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12d5c839 >2013-12-09 13:04:56,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12d5c839 >2013-12-09 13:05:01,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2115f1fc >2013-12-09 13:05:02,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2115f1fc >2013-12-09 13:05:02,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13be84ff >2013-12-09 13:05:02,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13be84ff >2013-12-09 13:05:07,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7810917d >2013-12-09 13:05:07,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7810917d >2013-12-09 13:05:07,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e8ef71f >2013-12-09 13:05:08,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e8ef71f >2013-12-09 13:05:13,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 551bd7e0 >2013-12-09 13:05:13,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 551bd7e0 >2013-12-09 13:05:13,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43cc5f9b >2013-12-09 13:05:13,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43cc5f9b >2013-12-09 13:05:18,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4915f83f >2013-12-09 13:05:19,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4915f83f >2013-12-09 13:05:19,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58ba4945 >2013-12-09 13:05:19,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58ba4945 >2013-12-09 13:05:24,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2508492b >2013-12-09 13:05:25,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2508492b >2013-12-09 13:05:25,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6cde3a37 >2013-12-09 13:05:25,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6cde3a37 >2013-12-09 13:05:30,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c228f1b >2013-12-09 13:05:30,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: c228f1b >2013-12-09 13:05:30,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4677c2f7 >2013-12-09 13:05:31,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4677c2f7 >2013-12-09 13:05:36,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2181aaea >2013-12-09 13:05:36,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2181aaea >2013-12-09 13:05:36,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31a48ecb >2013-12-09 13:05:37,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31a48ecb >2013-12-09 13:05:38,335 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-35) No up server in cluster >2013-12-09 13:05:38,336 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-35) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:05:38,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68ae3b2e >2013-12-09 13:05:38,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterTasksListVDSCommand, return: [], log id: 68ae3b2e >2013-12-09 13:05:42,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a5a46c8 >2013-12-09 13:05:42,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6a5a46c8 >2013-12-09 13:05:42,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 385fbc9 >2013-12-09 13:05:42,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 385fbc9 >2013-12-09 13:05:47,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f509699 >2013-12-09 13:05:48,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: f509699 >2013-12-09 13:05:48,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ec3bcc >2013-12-09 13:05:48,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ec3bcc >2013-12-09 13:05:53,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 147c046b >2013-12-09 13:05:54,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 147c046b >2013-12-09 13:05:54,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e108be0 >2013-12-09 13:05:54,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e108be0 >2013-12-09 13:05:59,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31d7c1af >2013-12-09 13:05:59,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 31d7c1af >2013-12-09 13:05:59,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 699a2414 >2013-12-09 13:06:00,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 699a2414 >2013-12-09 13:06:05,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52eadeff >2013-12-09 13:06:05,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 52eadeff >2013-12-09 13:06:05,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4dfda9bb >2013-12-09 13:06:05,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4dfda9bb >2013-12-09 13:06:10,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2609be7b >2013-12-09 13:06:11,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2609be7b >2013-12-09 13:06:11,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f4203d8 >2013-12-09 13:06:11,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f4203d8 >2013-12-09 13:06:16,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6289c1e4 >2013-12-09 13:06:17,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6289c1e4 >2013-12-09 13:06:17,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58a137a6 >2013-12-09 13:06:17,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58a137a6 >2013-12-09 13:06:22,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d8fcedf >2013-12-09 13:06:23,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d8fcedf >2013-12-09 13:06:23,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: bd7ca43 >2013-12-09 13:06:23,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: bd7ca43 >2013-12-09 13:06:28,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2cd514ab >2013-12-09 13:06:28,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2cd514ab >2013-12-09 13:06:28,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a300eaa >2013-12-09 13:06:29,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a300eaa >2013-12-09 13:06:34,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62905343 >2013-12-09 13:06:34,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 62905343 >2013-12-09 13:06:34,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 375f0921 >2013-12-09 13:06:34,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 375f0921 >2013-12-09 13:06:38,620 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-56) No up server in cluster >2013-12-09 13:06:38,620 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-56) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:06:38,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f16235e >2013-12-09 13:06:38,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2f16235e >2013-12-09 13:06:39,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c5e5456 >2013-12-09 13:06:40,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3c5e5456 >2013-12-09 13:06:40,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a60cb27 >2013-12-09 13:06:40,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a60cb27 >2013-12-09 13:06:45,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70af0e28 >2013-12-09 13:06:46,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 70af0e28 >2013-12-09 13:06:46,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2063523b >2013-12-09 13:06:46,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2063523b >2013-12-09 13:06:51,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6db33384 >2013-12-09 13:06:51,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6db33384 >2013-12-09 13:06:51,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ecdb9e3 >2013-12-09 13:06:52,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ecdb9e3 >2013-12-09 13:06:57,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d1240be >2013-12-09 13:06:57,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d1240be >2013-12-09 13:06:57,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 232c7af6 >2013-12-09 13:06:58,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 232c7af6 >2013-12-09 13:07:03,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 602c30ce >2013-12-09 13:07:03,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 602c30ce >2013-12-09 13:07:03,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7dea372f >2013-12-09 13:07:03,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7dea372f >2013-12-09 13:07:08,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d05ab5b >2013-12-09 13:07:09,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d05ab5b >2013-12-09 13:07:09,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ba06e11 >2013-12-09 13:07:09,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ba06e11 >2013-12-09 13:07:14,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11decabf >2013-12-09 13:07:15,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 11decabf >2013-12-09 13:07:15,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c54ccd0 >2013-12-09 13:07:15,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c54ccd0 >2013-12-09 13:07:20,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4015f7ca >2013-12-09 13:07:20,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4015f7ca >2013-12-09 13:07:20,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7dc93a6c >2013-12-09 13:07:21,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7dc93a6c >2013-12-09 13:07:26,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e3e70c4 >2013-12-09 13:07:26,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3e3e70c4 >2013-12-09 13:07:26,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4648c9e2 >2013-12-09 13:07:26,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4648c9e2 >2013-12-09 13:07:32,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c074eb >2013-12-09 13:07:32,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5c074eb >2013-12-09 13:07:32,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70848029 >2013-12-09 13:07:32,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70848029 >2013-12-09 13:07:37,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f53d051 >2013-12-09 13:07:38,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: f53d051 >2013-12-09 13:07:38,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20011a6b >2013-12-09 13:07:38,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20011a6b >2013-12-09 13:07:38,908 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-14) No up server in cluster >2013-12-09 13:07:38,908 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-14) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:07:38,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 569e3417 >2013-12-09 13:07:39,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterTasksListVDSCommand, return: [], log id: 569e3417 >2013-12-09 13:07:43,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13b89d1e >2013-12-09 13:07:44,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 13b89d1e >2013-12-09 13:07:44,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 14bbbc2e >2013-12-09 13:07:44,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14bbbc2e >2013-12-09 13:07:49,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20a4d62f >2013-12-09 13:07:49,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 20a4d62f >2013-12-09 13:07:49,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a624514 >2013-12-09 13:07:50,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a624514 >2013-12-09 13:07:55,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4576ca89 >2013-12-09 13:07:55,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4576ca89 >2013-12-09 13:07:55,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f968209 >2013-12-09 13:07:55,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f968209 >2013-12-09 13:08:00,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2278a7fc >2013-12-09 13:08:01,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2278a7fc >2013-12-09 13:08:01,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2292ceb8 >2013-12-09 13:08:01,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2292ceb8 >2013-12-09 13:08:06,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fe28613 >2013-12-09 13:08:07,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2fe28613 >2013-12-09 13:08:07,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57289434 >2013-12-09 13:08:07,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57289434 >2013-12-09 13:08:12,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d3d1814 >2013-12-09 13:08:13,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d3d1814 >2013-12-09 13:08:13,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a945fbd >2013-12-09 13:08:13,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a945fbd >2013-12-09 13:08:18,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5df41de4 >2013-12-09 13:08:18,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5df41de4 >2013-12-09 13:08:18,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: cc5e54d >2013-12-09 13:08:19,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: cc5e54d >2013-12-09 13:08:24,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 649d9c24 >2013-12-09 13:08:24,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 649d9c24 >2013-12-09 13:08:24,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5af3fb4f >2013-12-09 13:08:24,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5af3fb4f >2013-12-09 13:08:29,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5cb83bb6 >2013-12-09 13:08:30,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5cb83bb6 >2013-12-09 13:08:30,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 759ae46b >2013-12-09 13:08:30,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 759ae46b >2013-12-09 13:08:35,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53a66b8c >2013-12-09 13:08:36,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 53a66b8c >2013-12-09 13:08:36,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41f14ca9 >2013-12-09 13:08:36,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41f14ca9 >2013-12-09 13:08:39,188 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-45) No up server in cluster >2013-12-09 13:08:39,189 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-45) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:08:39,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 25e02c47 >2013-12-09 13:08:39,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterTasksListVDSCommand, return: [], log id: 25e02c47 >2013-12-09 13:08:41,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e0311c6 >2013-12-09 13:08:41,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2e0311c6 >2013-12-09 13:08:41,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ebf49d2 >2013-12-09 13:08:42,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ebf49d2 >2013-12-09 13:08:47,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5da0f185 >2013-12-09 13:08:47,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5da0f185 >2013-12-09 13:08:47,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72817a4c >2013-12-09 13:08:48,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72817a4c >2013-12-09 13:08:53,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b4a5530 >2013-12-09 13:08:53,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b4a5530 >2013-12-09 13:08:53,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e6a01e2 >2013-12-09 13:08:53,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e6a01e2 >2013-12-09 13:08:58,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 659353db >2013-12-09 13:08:59,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 659353db >2013-12-09 13:08:59,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 678c69b2 >2013-12-09 13:08:59,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 678c69b2 >2013-12-09 13:09:04,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 315b6749 >2013-12-09 13:09:05,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 315b6749 >2013-12-09 13:09:05,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53c83304 >2013-12-09 13:09:05,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53c83304 >2013-12-09 13:09:10,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d74d088 >2013-12-09 13:09:10,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6d74d088 >2013-12-09 13:09:10,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74d3b41f >2013-12-09 13:09:11,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74d3b41f >2013-12-09 13:09:16,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f33effe >2013-12-09 13:09:16,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5f33effe >2013-12-09 13:09:16,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c136e43 >2013-12-09 13:09:16,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c136e43 >2013-12-09 13:09:21,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10090cb3 >2013-12-09 13:09:22,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 10090cb3 >2013-12-09 13:09:22,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d9493c7 >2013-12-09 13:09:22,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d9493c7 >2013-12-09 13:09:27,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ca238e9 >2013-12-09 13:09:28,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2ca238e9 >2013-12-09 13:09:28,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63aac456 >2013-12-09 13:09:28,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63aac456 >2013-12-09 13:09:33,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b5341a >2013-12-09 13:09:34,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1b5341a >2013-12-09 13:09:34,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5091ba7b >2013-12-09 13:09:34,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5091ba7b >2013-12-09 13:09:39,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 84337c0 >2013-12-09 13:09:39,464 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-94) No up server in cluster >2013-12-09 13:09:39,464 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-94) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:09:39,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64ba934 >2013-12-09 13:09:39,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterTasksListVDSCommand, return: [], log id: 64ba934 >2013-12-09 13:09:39,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 84337c0 >2013-12-09 13:09:39,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48656c71 >2013-12-09 13:09:40,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48656c71 >2013-12-09 13:09:45,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78579a77 >2013-12-09 13:09:45,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 78579a77 >2013-12-09 13:09:45,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10c234b2 >2013-12-09 13:09:45,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10c234b2 >2013-12-09 13:09:50,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5beedc12 >2013-12-09 13:09:51,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5beedc12 >2013-12-09 13:09:51,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10757a95 >2013-12-09 13:09:51,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10757a95 >2013-12-09 13:09:56,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bc1297e >2013-12-09 13:09:57,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1bc1297e >2013-12-09 13:09:57,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38b07b16 >2013-12-09 13:09:57,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38b07b16 >2013-12-09 13:10:02,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 342500ca >2013-12-09 13:10:02,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 342500ca >2013-12-09 13:10:02,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29e0c991 >2013-12-09 13:10:03,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29e0c991 >2013-12-09 13:10:08,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ca08ac4 >2013-12-09 13:10:08,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ca08ac4 >2013-12-09 13:10:08,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57a43e3b >2013-12-09 13:10:09,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57a43e3b >2013-12-09 13:10:14,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3489232 >2013-12-09 13:10:14,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3489232 >2013-12-09 13:10:14,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8366e0c >2013-12-09 13:10:14,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8366e0c >2013-12-09 13:10:19,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4031d2f3 >2013-12-09 13:10:20,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4031d2f3 >2013-12-09 13:10:20,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11b36316 >2013-12-09 13:10:20,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11b36316 >2013-12-09 13:10:25,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c05462c >2013-12-09 13:10:26,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c05462c >2013-12-09 13:10:26,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50f9a2c >2013-12-09 13:10:26,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50f9a2c >2013-12-09 13:10:31,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c65a8ab >2013-12-09 13:10:31,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6c65a8ab >2013-12-09 13:10:31,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2113d023 >2013-12-09 13:10:32,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2113d023 >2013-12-09 13:10:37,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b317db4 >2013-12-09 13:10:37,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b317db4 >2013-12-09 13:10:37,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ff1d301 >2013-12-09 13:10:37,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ff1d301 >2013-12-09 13:10:39,723 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-28) No up server in cluster >2013-12-09 13:10:39,724 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-28) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:10:39,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f98c36f >2013-12-09 13:10:40,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterTasksListVDSCommand, return: [], log id: f98c36f >2013-12-09 13:10:42,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d281cf7 >2013-12-09 13:10:43,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d281cf7 >2013-12-09 13:10:43,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1dea3aac >2013-12-09 13:10:43,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1dea3aac >2013-12-09 13:10:48,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7da6efb4 >2013-12-09 13:10:49,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7da6efb4 >2013-12-09 13:10:49,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ad1925 >2013-12-09 13:10:49,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ad1925 >2013-12-09 13:10:54,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1cbcf9a1 >2013-12-09 13:10:54,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1cbcf9a1 >2013-12-09 13:10:54,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4497e7f7 >2013-12-09 13:10:55,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4497e7f7 >2013-12-09 13:11:00,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 605a33fa >2013-12-09 13:11:00,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 605a33fa >2013-12-09 13:11:00,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d67737c >2013-12-09 13:11:01,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d67737c >2013-12-09 13:11:06,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 678fa653 >2013-12-09 13:11:06,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 678fa653 >2013-12-09 13:11:06,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a9bb42c >2013-12-09 13:11:06,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a9bb42c >2013-12-09 13:11:11,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c738770 >2013-12-09 13:11:12,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c738770 >2013-12-09 13:11:12,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 25fbdc45 >2013-12-09 13:11:12,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25fbdc45 >2013-12-09 13:11:17,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 786dd29e >2013-12-09 13:11:18,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 786dd29e >2013-12-09 13:11:18,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 417aad4 >2013-12-09 13:11:18,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 417aad4 >2013-12-09 13:11:23,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 417e49b5 >2013-12-09 13:11:23,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 417e49b5 >2013-12-09 13:11:23,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 444e53f9 >2013-12-09 13:11:24,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 444e53f9 >2013-12-09 13:11:29,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 270fecfe >2013-12-09 13:11:29,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 270fecfe >2013-12-09 13:11:29,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8b91c72 >2013-12-09 13:11:29,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8b91c72 >2013-12-09 13:11:34,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5877dfbc >2013-12-09 13:11:35,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5877dfbc >2013-12-09 13:11:35,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38192c02 >2013-12-09 13:11:35,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38192c02 >2013-12-09 13:11:40,019 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-82) No up server in cluster >2013-12-09 13:11:40,019 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-82) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:11:40,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3844f954 >2013-12-09 13:11:40,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3844f954 >2013-12-09 13:11:40,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a056fe7 >2013-12-09 13:11:41,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2a056fe7 >2013-12-09 13:11:41,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71a52ae4 >2013-12-09 13:11:41,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71a52ae4 >2013-12-09 13:11:46,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b4ef18a >2013-12-09 13:11:46,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b4ef18a >2013-12-09 13:11:46,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d67b1aa >2013-12-09 13:11:47,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d67b1aa >2013-12-09 13:11:52,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7cdd6397 >2013-12-09 13:11:52,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7cdd6397 >2013-12-09 13:11:52,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ad44a81 >2013-12-09 13:11:53,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ad44a81 >2013-12-09 13:11:58,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a0e461e >2013-12-09 13:11:58,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7a0e461e >2013-12-09 13:11:58,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7179e8b8 >2013-12-09 13:11:58,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7179e8b8 >2013-12-09 13:12:03,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c25e1fe >2013-12-09 13:12:04,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2c25e1fe >2013-12-09 13:12:04,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c16ba10 >2013-12-09 13:12:04,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c16ba10 >2013-12-09 13:12:09,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 755e9e33 >2013-12-09 13:12:10,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 755e9e33 >2013-12-09 13:12:10,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 730a77b3 >2013-12-09 13:12:10,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 730a77b3 >2013-12-09 13:12:15,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11b7a17b >2013-12-09 13:12:15,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 11b7a17b >2013-12-09 13:12:15,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 631ce9fe >2013-12-09 13:12:16,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 631ce9fe >2013-12-09 13:12:21,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 131cfa1f >2013-12-09 13:12:21,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 131cfa1f >2013-12-09 13:12:21,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a5925a0 >2013-12-09 13:12:21,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a5925a0 >2013-12-09 13:12:26,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 484c8506 >2013-12-09 13:12:27,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 484c8506 >2013-12-09 13:12:27,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3683e2f2 >2013-12-09 13:12:27,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3683e2f2 >2013-12-09 13:12:32,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45b3b06c >2013-12-09 13:12:33,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 45b3b06c >2013-12-09 13:12:33,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 600ca9b6 >2013-12-09 13:12:33,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 600ca9b6 >2013-12-09 13:12:38,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59431b0b >2013-12-09 13:12:38,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 59431b0b >2013-12-09 13:12:38,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2916126e >2013-12-09 13:12:39,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2916126e >2013-12-09 13:12:40,291 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-91) No up server in cluster >2013-12-09 13:12:40,292 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-91) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:12:40,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3df0cdab >2013-12-09 13:12:40,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3df0cdab >2013-12-09 13:12:44,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 390f1acf >2013-12-09 13:12:44,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 390f1acf >2013-12-09 13:12:44,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e77475 >2013-12-09 13:12:45,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e77475 >2013-12-09 13:12:50,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11a028ab >2013-12-09 13:12:50,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 11a028ab >2013-12-09 13:12:50,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68d46309 >2013-12-09 13:12:50,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68d46309 >2013-12-09 13:12:55,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64f49e49 >2013-12-09 13:12:56,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 64f49e49 >2013-12-09 13:12:56,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 639e5225 >2013-12-09 13:12:56,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 639e5225 >2013-12-09 13:13:01,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60673cb9 >2013-12-09 13:13:02,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 60673cb9 >2013-12-09 13:13:02,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1268f767 >2013-12-09 13:13:02,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1268f767 >2013-12-09 13:13:07,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7bae600d >2013-12-09 13:13:07,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7bae600d >2013-12-09 13:13:07,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5eae09a0 >2013-12-09 13:13:08,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5eae09a0 >2013-12-09 13:13:13,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19c812d1 >2013-12-09 13:13:13,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 19c812d1 >2013-12-09 13:13:13,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3fd69989 >2013-12-09 13:13:13,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3fd69989 >2013-12-09 13:13:18,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ed3bab7 >2013-12-09 13:13:19,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6ed3bab7 >2013-12-09 13:13:19,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a6cdfa2 >2013-12-09 13:13:19,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a6cdfa2 >2013-12-09 13:13:24,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a48ec40 >2013-12-09 13:13:25,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2a48ec40 >2013-12-09 13:13:25,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36e0d5c1 >2013-12-09 13:13:25,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36e0d5c1 >2013-12-09 13:13:30,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ad0f1c1 >2013-12-09 13:13:30,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ad0f1c1 >2013-12-09 13:13:30,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 255fd7e1 >2013-12-09 13:13:31,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 255fd7e1 >2013-12-09 13:13:36,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9ff54a9 >2013-12-09 13:13:36,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 9ff54a9 >2013-12-09 13:13:36,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53bb4b04 >2013-12-09 13:13:37,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53bb4b04 >2013-12-09 13:13:40,566 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-87) No up server in cluster >2013-12-09 13:13:40,566 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-87) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:13:40,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 216e8fae >2013-12-09 13:13:40,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterTasksListVDSCommand, return: [], log id: 216e8fae >2013-12-09 13:13:42,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 543685fd >2013-12-09 13:13:42,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 543685fd >2013-12-09 13:13:42,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e48da5a >2013-12-09 13:13:42,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e48da5a >2013-12-09 13:13:47,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d23779c >2013-12-09 13:13:48,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d23779c >2013-12-09 13:13:48,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a70bcc5 >2013-12-09 13:13:48,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a70bcc5 >2013-12-09 13:13:53,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33c17e8 >2013-12-09 13:13:54,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 33c17e8 >2013-12-09 13:13:54,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1518d41c >2013-12-09 13:13:54,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1518d41c >2013-12-09 13:13:59,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10304a09 >2013-12-09 13:13:59,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 10304a09 >2013-12-09 13:13:59,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41d37b04 >2013-12-09 13:14:00,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41d37b04 >2013-12-09 13:14:05,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f2a41fe >2013-12-09 13:14:05,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5f2a41fe >2013-12-09 13:14:05,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13db29f7 >2013-12-09 13:14:06,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13db29f7 >2013-12-09 13:14:11,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f0c025c >2013-12-09 13:14:11,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f0c025c >2013-12-09 13:14:11,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74f6ff91 >2013-12-09 13:14:11,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74f6ff91 >2013-12-09 13:14:16,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d07e3a0 >2013-12-09 13:14:17,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d07e3a0 >2013-12-09 13:14:17,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 717bfadd >2013-12-09 13:14:17,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 717bfadd >2013-12-09 13:14:22,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45dfb1f8 >2013-12-09 13:14:23,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 45dfb1f8 >2013-12-09 13:14:23,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 594decde >2013-12-09 13:14:23,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 594decde >2013-12-09 13:14:28,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62662477 >2013-12-09 13:14:28,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 62662477 >2013-12-09 13:14:28,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a7fdfdf >2013-12-09 13:14:29,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a7fdfdf >2013-12-09 13:14:34,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a09b079 >2013-12-09 13:14:34,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3a09b079 >2013-12-09 13:14:34,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e6f58d3 >2013-12-09 13:14:34,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e6f58d3 >2013-12-09 13:14:39,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7529e43c >2013-12-09 13:14:40,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7529e43c >2013-12-09 13:14:40,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34c2f5cc >2013-12-09 13:14:40,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34c2f5cc >2013-12-09 13:14:40,856 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) No up server in cluster >2013-12-09 13:14:40,856 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:14:40,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 592fa343 >2013-12-09 13:14:41,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterTasksListVDSCommand, return: [], log id: 592fa343 >2013-12-09 13:14:45,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ca360ff >2013-12-09 13:14:46,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5ca360ff >2013-12-09 13:14:46,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67db5927 >2013-12-09 13:14:46,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67db5927 >2013-12-09 13:14:51,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42a559e8 >2013-12-09 13:14:51,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 42a559e8 >2013-12-09 13:14:51,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 500eca76 >2013-12-09 13:14:52,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 500eca76 >2013-12-09 13:14:57,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5af06c8f >2013-12-09 13:14:57,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5af06c8f >2013-12-09 13:14:57,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 759eef09 >2013-12-09 13:14:58,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 759eef09 >2013-12-09 13:15:03,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 224df3e >2013-12-09 13:15:03,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 224df3e >2013-12-09 13:15:03,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e745db >2013-12-09 13:15:03,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e745db >2013-12-09 13:15:08,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ed1343d >2013-12-09 13:15:09,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: ed1343d >2013-12-09 13:15:09,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21e598f9 >2013-12-09 13:15:09,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21e598f9 >2013-12-09 13:15:14,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 327f4804 >2013-12-09 13:15:15,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 327f4804 >2013-12-09 13:15:15,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b0de90d >2013-12-09 13:15:15,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b0de90d >2013-12-09 13:15:20,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a6b626c >2013-12-09 13:15:20,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7a6b626c >2013-12-09 13:15:20,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6722cea5 >2013-12-09 13:15:21,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6722cea5 >2013-12-09 13:15:26,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 766cfe60 >2013-12-09 13:15:26,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 766cfe60 >2013-12-09 13:15:26,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78c63b81 >2013-12-09 13:15:26,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78c63b81 >2013-12-09 13:15:31,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4882dc43 >2013-12-09 13:15:32,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4882dc43 >2013-12-09 13:15:32,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e7fdf07 >2013-12-09 13:15:32,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e7fdf07 >2013-12-09 13:15:37,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 485a895e >2013-12-09 13:15:38,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 485a895e >2013-12-09 13:15:38,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3817ceb0 >2013-12-09 13:15:38,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3817ceb0 >2013-12-09 13:15:41,151 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-39) [63f3d095] No up server in cluster >2013-12-09 13:15:41,151 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-39) [63f3d095] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:15:41,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32d1b0e1 >2013-12-09 13:15:41,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterTasksListVDSCommand, return: [], log id: 32d1b0e1 >2013-12-09 13:15:43,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 279d4590 >2013-12-09 13:15:43,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 279d4590 >2013-12-09 13:15:43,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ab25d2 >2013-12-09 13:15:44,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ab25d2 >2013-12-09 13:15:49,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d4a41c7 >2013-12-09 13:15:49,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d4a41c7 >2013-12-09 13:15:49,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71f4795c >2013-12-09 13:15:49,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71f4795c >2013-12-09 13:15:54,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39c0b949 >2013-12-09 13:15:55,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 39c0b949 >2013-12-09 13:15:55,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5bef0dc1 >2013-12-09 13:15:55,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5bef0dc1 >2013-12-09 13:16:00,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d38196b >2013-12-09 13:16:01,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d38196b >2013-12-09 13:16:01,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4dbece7 >2013-12-09 13:16:01,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4dbece7 >2013-12-09 13:16:06,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78541d97 >2013-12-09 13:16:07,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 78541d97 >2013-12-09 13:16:07,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6511f87e >2013-12-09 13:16:07,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6511f87e >2013-12-09 13:16:12,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3280403f >2013-12-09 13:16:12,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3280403f >2013-12-09 13:16:12,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e5ba099 >2013-12-09 13:16:13,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e5ba099 >2013-12-09 13:16:18,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 135823d4 >2013-12-09 13:16:18,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 135823d4 >2013-12-09 13:16:18,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35f263a6 >2013-12-09 13:16:18,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35f263a6 >2013-12-09 13:16:23,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e23ae07 >2013-12-09 13:16:24,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e23ae07 >2013-12-09 13:16:24,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 262e98d5 >2013-12-09 13:16:24,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 262e98d5 >2013-12-09 13:16:29,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 655549a6 >2013-12-09 13:16:30,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 655549a6 >2013-12-09 13:16:30,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b54426c >2013-12-09 13:16:30,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b54426c >2013-12-09 13:16:35,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13a78994 >2013-12-09 13:16:35,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 13a78994 >2013-12-09 13:16:35,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8b9a2bd >2013-12-09 13:16:36,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8b9a2bd >2013-12-09 13:16:41,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 372abc6c >2013-12-09 13:16:41,435 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-22) No up server in cluster >2013-12-09 13:16:41,435 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-22) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:16:41,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b22425 >2013-12-09 13:16:41,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5b22425 >2013-12-09 13:16:41,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 372abc6c >2013-12-09 13:16:41,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c23086c >2013-12-09 13:16:41,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c23086c >2013-12-09 13:16:46,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b093174 >2013-12-09 13:16:47,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b093174 >2013-12-09 13:16:47,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54e5633e >2013-12-09 13:16:47,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54e5633e >2013-12-09 13:16:52,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b519afe >2013-12-09 13:16:53,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1b519afe >2013-12-09 13:16:53,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79f7d95c >2013-12-09 13:16:53,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79f7d95c >2013-12-09 13:16:58,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a775aee >2013-12-09 13:16:59,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a775aee >2013-12-09 13:16:59,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 294d74a0 >2013-12-09 13:16:59,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 294d74a0 >2013-12-09 13:17:04,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26ca0857 >2013-12-09 13:17:04,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 26ca0857 >2013-12-09 13:17:04,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3fe36614 >2013-12-09 13:17:05,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3fe36614 >2013-12-09 13:17:10,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f6e5d8 >2013-12-09 13:17:10,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f6e5d8 >2013-12-09 13:17:10,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e75d9ca >2013-12-09 13:17:10,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e75d9ca >2013-12-09 13:17:15,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14f96236 >2013-12-09 13:17:16,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 14f96236 >2013-12-09 13:17:16,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e75ff27 >2013-12-09 13:17:16,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e75ff27 >2013-12-09 13:17:21,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34727f4e >2013-12-09 13:17:22,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 34727f4e >2013-12-09 13:17:22,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 647ad9bc >2013-12-09 13:17:22,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 647ad9bc >2013-12-09 13:17:27,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6139af69 >2013-12-09 13:17:27,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6139af69 >2013-12-09 13:17:27,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 629e938 >2013-12-09 13:17:28,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 629e938 >2013-12-09 13:17:33,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52f4f954 >2013-12-09 13:17:33,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 52f4f954 >2013-12-09 13:17:33,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5aee5ab9 >2013-12-09 13:17:33,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5aee5ab9 >2013-12-09 13:17:39,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 557cf485 >2013-12-09 13:17:39,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 557cf485 >2013-12-09 13:17:39,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7283564d >2013-12-09 13:17:39,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7283564d >2013-12-09 13:17:41,693 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) No up server in cluster >2013-12-09 13:17:41,693 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:17:41,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6773fefe >2013-12-09 13:17:41,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6773fefe >2013-12-09 13:17:44,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f8cecb8 >2013-12-09 13:17:45,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f8cecb8 >2013-12-09 13:17:45,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4011abf0 >2013-12-09 13:17:45,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4011abf0 >2013-12-09 13:17:50,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 24906b72 >2013-12-09 13:17:51,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 24906b72 >2013-12-09 13:17:51,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36533772 >2013-12-09 13:17:51,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36533772 >2013-12-09 13:17:56,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 745dec56 >2013-12-09 13:17:56,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 745dec56 >2013-12-09 13:17:56,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45cddbd6 >2013-12-09 13:17:57,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45cddbd6 >2013-12-09 13:18:02,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3365dc14 >2013-12-09 13:18:02,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3365dc14 >2013-12-09 13:18:02,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ee10db >2013-12-09 13:18:02,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ee10db >2013-12-09 13:18:07,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9d16e20 >2013-12-09 13:18:08,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 9d16e20 >2013-12-09 13:18:08,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 610c7056 >2013-12-09 13:18:08,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 610c7056 >2013-12-09 13:18:13,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 634cf70f >2013-12-09 13:18:14,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 634cf70f >2013-12-09 13:18:14,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d6f5726 >2013-12-09 13:18:14,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d6f5726 >2013-12-09 13:18:19,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6668c741 >2013-12-09 13:18:19,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6668c741 >2013-12-09 13:18:19,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 609f451f >2013-12-09 13:18:20,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 609f451f >2013-12-09 13:18:25,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4cca8152 >2013-12-09 13:18:25,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4cca8152 >2013-12-09 13:18:25,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6435a575 >2013-12-09 13:18:25,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6435a575 >2013-12-09 13:18:30,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 670f1899 >2013-12-09 13:18:31,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 670f1899 >2013-12-09 13:18:31,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f83155c >2013-12-09 13:18:31,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f83155c >2013-12-09 13:18:36,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38dbc8c0 >2013-12-09 13:18:37,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 38dbc8c0 >2013-12-09 13:18:37,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 196391e5 >2013-12-09 13:18:37,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 196391e5 >2013-12-09 13:18:41,970 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-26) No up server in cluster >2013-12-09 13:18:41,971 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-26) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:18:41,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7902f18e >2013-12-09 13:18:42,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7902f18e >2013-12-09 13:18:42,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59062aa >2013-12-09 13:18:43,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59062aa >2013-12-09 13:18:43,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e13b20a >2013-12-09 13:18:43,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e13b20a >2013-12-09 13:18:48,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a5badc2 >2013-12-09 13:18:48,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6a5badc2 >2013-12-09 13:18:48,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4dfbcfee >2013-12-09 13:18:49,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4dfbcfee >2013-12-09 13:18:54,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 427e177d >2013-12-09 13:18:54,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 427e177d >2013-12-09 13:18:54,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d857239 >2013-12-09 13:18:54,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d857239 >2013-12-09 13:18:59,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e6056f7 >2013-12-09 13:19:00,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e6056f7 >2013-12-09 13:19:00,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ef454c5 >2013-12-09 13:19:00,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ef454c5 >2013-12-09 13:19:05,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25bdca82 >2013-12-09 13:19:06,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 25bdca82 >2013-12-09 13:19:06,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1dcebfcf >2013-12-09 13:19:06,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1dcebfcf >2013-12-09 13:19:11,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4936e100 >2013-12-09 13:19:12,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4936e100 >2013-12-09 13:19:12,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 497482f4 >2013-12-09 13:19:12,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 497482f4 >2013-12-09 13:19:17,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e727f3d >2013-12-09 13:19:17,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e727f3d >2013-12-09 13:19:17,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68c8b183 >2013-12-09 13:19:18,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68c8b183 >2013-12-09 13:19:23,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20877e98 >2013-12-09 13:19:23,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 20877e98 >2013-12-09 13:19:23,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3fc43fe4 >2013-12-09 13:19:23,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3fc43fe4 >2013-12-09 13:19:28,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18e79193 >2013-12-09 13:19:29,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 18e79193 >2013-12-09 13:19:29,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5de7be60 >2013-12-09 13:19:29,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5de7be60 >2013-12-09 13:19:34,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a5626ef >2013-12-09 13:19:35,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a5626ef >2013-12-09 13:19:35,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6af32c24 >2013-12-09 13:19:35,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6af32c24 >2013-12-09 13:19:40,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74381081 >2013-12-09 13:19:40,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 74381081 >2013-12-09 13:19:40,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ae56ead >2013-12-09 13:19:41,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ae56ead >2013-12-09 13:19:42,249 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-31) No up server in cluster >2013-12-09 13:19:42,249 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-31) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:19:42,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f1826c5 >2013-12-09 13:19:42,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2f1826c5 >2013-12-09 13:19:46,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f95708b >2013-12-09 13:19:46,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f95708b >2013-12-09 13:19:46,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a43f153 >2013-12-09 13:19:46,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a43f153 >2013-12-09 13:19:51,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c53fb29 >2013-12-09 13:19:52,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c53fb29 >2013-12-09 13:19:52,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ea8929d >2013-12-09 13:19:52,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ea8929d >2013-12-09 13:19:57,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53407ae5 >2013-12-09 13:19:58,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 53407ae5 >2013-12-09 13:19:58,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73467168 >2013-12-09 13:19:58,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73467168 >2013-12-09 13:20:03,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40443e01 >2013-12-09 13:20:04,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 40443e01 >2013-12-09 13:20:04,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5134758a >2013-12-09 13:20:04,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5134758a >2013-12-09 13:20:09,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ef0740d >2013-12-09 13:20:09,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3ef0740d >2013-12-09 13:20:09,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e4b4dff >2013-12-09 13:20:10,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e4b4dff >2013-12-09 13:20:15,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ae9905a >2013-12-09 13:20:15,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: ae9905a >2013-12-09 13:20:15,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21a4a00a >2013-12-09 13:20:15,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21a4a00a >2013-12-09 13:20:20,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 273ece13 >2013-12-09 13:20:21,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 273ece13 >2013-12-09 13:20:21,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46f6f516 >2013-12-09 13:20:21,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46f6f516 >2013-12-09 13:20:26,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5813e209 >2013-12-09 13:20:27,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5813e209 >2013-12-09 13:20:27,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fad1049 >2013-12-09 13:20:27,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fad1049 >2013-12-09 13:20:32,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1982383f >2013-12-09 13:20:32,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1982383f >2013-12-09 13:20:32,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37311a74 >2013-12-09 13:20:33,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37311a74 >2013-12-09 13:20:38,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31472872 >2013-12-09 13:20:38,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 31472872 >2013-12-09 13:20:38,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16cda66e >2013-12-09 13:20:38,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16cda66e >2013-12-09 13:20:42,545 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) No up server in cluster >2013-12-09 13:20:42,545 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:20:42,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29230f67 >2013-12-09 13:20:42,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterTasksListVDSCommand, return: [], log id: 29230f67 >2013-12-09 13:20:43,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52de9334 >2013-12-09 13:20:44,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 52de9334 >2013-12-09 13:20:44,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45e28e5d >2013-12-09 13:20:44,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45e28e5d >2013-12-09 13:20:49,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74ca2df8 >2013-12-09 13:20:50,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 74ca2df8 >2013-12-09 13:20:50,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7191514c >2013-12-09 13:20:50,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7191514c >2013-12-09 13:20:55,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34f0e28 >2013-12-09 13:20:56,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 34f0e28 >2013-12-09 13:20:56,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67b79e97 >2013-12-09 13:20:56,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67b79e97 >2013-12-09 13:21:01,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d4c80cb >2013-12-09 13:21:01,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d4c80cb >2013-12-09 13:21:01,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 362f9707 >2013-12-09 13:21:02,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 362f9707 >2013-12-09 13:21:07,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e4b5333 >2013-12-09 13:21:07,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: e4b5333 >2013-12-09 13:21:07,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8fd2aae >2013-12-09 13:21:07,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8fd2aae >2013-12-09 13:21:12,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62f7b889 >2013-12-09 13:21:13,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 62f7b889 >2013-12-09 13:21:13,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1069d73f >2013-12-09 13:21:13,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1069d73f >2013-12-09 13:21:18,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 94fdd5b >2013-12-09 13:21:19,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 94fdd5b >2013-12-09 13:21:19,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 307b2ecd >2013-12-09 13:21:19,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 307b2ecd >2013-12-09 13:21:24,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ebe88be >2013-12-09 13:21:24,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ebe88be >2013-12-09 13:21:24,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1cad241f >2013-12-09 13:21:25,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1cad241f >2013-12-09 13:21:30,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a4a45bb >2013-12-09 13:21:30,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a4a45bb >2013-12-09 13:21:30,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10e3e8a4 >2013-12-09 13:21:31,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10e3e8a4 >2013-12-09 13:21:36,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3be8579b >2013-12-09 13:21:36,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3be8579b >2013-12-09 13:21:36,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53bca3d >2013-12-09 13:21:36,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53bca3d >2013-12-09 13:21:41,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e3e9492 >2013-12-09 13:21:42,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e3e9492 >2013-12-09 13:21:42,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6668eec8 >2013-12-09 13:21:42,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6668eec8 >2013-12-09 13:21:42,833 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) No up server in cluster >2013-12-09 13:21:42,833 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:21:42,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68a58c34 >2013-12-09 13:21:43,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterTasksListVDSCommand, return: [], log id: 68a58c34 >2013-12-09 13:21:47,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46d1116f >2013-12-09 13:21:48,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 46d1116f >2013-12-09 13:21:48,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3507ba3 >2013-12-09 13:21:48,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3507ba3 >2013-12-09 13:21:53,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76e63b18 >2013-12-09 13:21:53,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 76e63b18 >2013-12-09 13:21:53,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4eae8c23 >2013-12-09 13:21:54,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4eae8c23 >2013-12-09 13:21:59,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f86fce5 >2013-12-09 13:21:59,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1f86fce5 >2013-12-09 13:21:59,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ab98a01 >2013-12-09 13:21:59,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ab98a01 >2013-12-09 13:22:04,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4589c6ea >2013-12-09 13:22:05,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4589c6ea >2013-12-09 13:22:05,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 181fe4e0 >2013-12-09 13:22:05,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 181fe4e0 >2013-12-09 13:22:10,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8f2255f >2013-12-09 13:22:11,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 8f2255f >2013-12-09 13:22:11,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ba34ede >2013-12-09 13:22:11,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ba34ede >2013-12-09 13:22:16,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ae33044 >2013-12-09 13:22:17,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1ae33044 >2013-12-09 13:22:17,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43c83f50 >2013-12-09 13:22:17,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43c83f50 >2013-12-09 13:22:22,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d269089 >2013-12-09 13:22:22,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d269089 >2013-12-09 13:22:22,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5dbc5395 >2013-12-09 13:22:23,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5dbc5395 >2013-12-09 13:22:28,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35c8607b >2013-12-09 13:22:28,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 35c8607b >2013-12-09 13:22:28,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38daeeaa >2013-12-09 13:22:28,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38daeeaa >2013-12-09 13:22:33,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61ff1e3 >2013-12-09 13:22:34,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 61ff1e3 >2013-12-09 13:22:34,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3232cafe >2013-12-09 13:22:34,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3232cafe >2013-12-09 13:22:39,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 257a77dd >2013-12-09 13:22:40,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 257a77dd >2013-12-09 13:22:40,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6985c1f6 >2013-12-09 13:22:40,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6985c1f6 >2013-12-09 13:22:43,131 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-38) No up server in cluster >2013-12-09 13:22:43,132 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-38) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:22:43,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78a0514 >2013-12-09 13:22:43,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterTasksListVDSCommand, return: [], log id: 78a0514 >2013-12-09 13:22:45,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1fa5c82a >2013-12-09 13:22:45,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1fa5c82a >2013-12-09 13:22:45,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46c7fff8 >2013-12-09 13:22:46,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46c7fff8 >2013-12-09 13:22:51,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4cef8eef >2013-12-09 13:22:51,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4cef8eef >2013-12-09 13:22:51,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 567d2a4 >2013-12-09 13:22:52,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 567d2a4 >2013-12-09 13:22:57,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1348470a >2013-12-09 13:22:57,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1348470a >2013-12-09 13:22:57,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28476d4e >2013-12-09 13:22:57,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28476d4e >2013-12-09 13:23:02,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1667062e >2013-12-09 13:23:03,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1667062e >2013-12-09 13:23:03,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20577e7f >2013-12-09 13:23:03,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20577e7f >2013-12-09 13:23:08,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36d998c4 >2013-12-09 13:23:09,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 36d998c4 >2013-12-09 13:23:09,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12aa979e >2013-12-09 13:23:09,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12aa979e >2013-12-09 13:23:14,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c95a869 >2013-12-09 13:23:14,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1c95a869 >2013-12-09 13:23:14,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ca10edc >2013-12-09 13:23:15,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ca10edc >2013-12-09 13:23:20,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 649555ba >2013-12-09 13:23:20,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 649555ba >2013-12-09 13:23:20,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7dd8c3c9 >2013-12-09 13:23:20,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7dd8c3c9 >2013-12-09 13:23:25,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f9fde47 >2013-12-09 13:23:26,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f9fde47 >2013-12-09 13:23:26,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63b83446 >2013-12-09 13:23:26,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63b83446 >2013-12-09 13:23:31,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43139c54 >2013-12-09 13:23:32,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 43139c54 >2013-12-09 13:23:32,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6bd983fb >2013-12-09 13:23:32,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6bd983fb >2013-12-09 13:23:37,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3492f55b >2013-12-09 13:23:38,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3492f55b >2013-12-09 13:23:38,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48793688 >2013-12-09 13:23:38,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48793688 >2013-12-09 13:23:43,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ee0ddbe >2013-12-09 13:23:43,408 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-30) No up server in cluster >2013-12-09 13:23:43,408 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-30) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:23:43,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 14a9250c >2013-12-09 13:23:43,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterTasksListVDSCommand, return: [], log id: 14a9250c >2013-12-09 13:23:43,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ee0ddbe >2013-12-09 13:23:43,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 494a4640 >2013-12-09 13:23:44,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 494a4640 >2013-12-09 13:23:49,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7455e869 >2013-12-09 13:23:49,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7455e869 >2013-12-09 13:23:49,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2792e452 >2013-12-09 13:23:49,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2792e452 >2013-12-09 13:23:54,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a30dcb9 >2013-12-09 13:23:55,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7a30dcb9 >2013-12-09 13:23:55,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2156ba >2013-12-09 13:23:55,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2156ba >2013-12-09 13:24:00,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ab847d3 >2013-12-09 13:24:01,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ab847d3 >2013-12-09 13:24:01,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ff7a5d6 >2013-12-09 13:24:01,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ff7a5d6 >2013-12-09 13:24:06,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b289f7 >2013-12-09 13:24:06,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b289f7 >2013-12-09 13:24:06,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 759ec89 >2013-12-09 13:24:07,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 759ec89 >2013-12-09 13:24:12,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 545b3143 >2013-12-09 13:24:12,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 545b3143 >2013-12-09 13:24:12,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27fc3814 >2013-12-09 13:24:13,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27fc3814 >2013-12-09 13:24:18,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f7073f6 >2013-12-09 13:24:18,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f7073f6 >2013-12-09 13:24:18,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c8f4f37 >2013-12-09 13:24:18,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c8f4f37 >2013-12-09 13:24:23,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6faf60d0 >2013-12-09 13:24:24,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6faf60d0 >2013-12-09 13:24:24,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72e78706 >2013-12-09 13:24:24,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72e78706 >2013-12-09 13:24:29,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 531bbc5f >2013-12-09 13:24:30,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 531bbc5f >2013-12-09 13:24:30,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11d36c08 >2013-12-09 13:24:30,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11d36c08 >2013-12-09 13:24:35,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a070164 >2013-12-09 13:24:35,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7a070164 >2013-12-09 13:24:35,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8a8529d >2013-12-09 13:24:36,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8a8529d >2013-12-09 13:24:41,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5355d963 >2013-12-09 13:24:41,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5355d963 >2013-12-09 13:24:41,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e8887ac >2013-12-09 13:24:41,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e8887ac >2013-12-09 13:24:43,684 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-1) No up server in cluster >2013-12-09 13:24:43,684 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-1) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:24:43,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 386df358 >2013-12-09 13:24:43,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterTasksListVDSCommand, return: [], log id: 386df358 >2013-12-09 13:24:46,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c4c5163 >2013-12-09 13:24:47,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c4c5163 >2013-12-09 13:24:47,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32d41569 >2013-12-09 13:24:47,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32d41569 >2013-12-09 13:24:52,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 502b0a2d >2013-12-09 13:24:53,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 502b0a2d >2013-12-09 13:24:53,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15617037 >2013-12-09 13:24:53,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15617037 >2013-12-09 13:24:58,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1022f382 >2013-12-09 13:24:58,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1022f382 >2013-12-09 13:24:58,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f1bf817 >2013-12-09 13:24:59,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f1bf817 >2013-12-09 13:25:04,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19a6c68c >2013-12-09 13:25:04,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19a6c68c >2013-12-09 13:25:04,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fedd33d >2013-12-09 13:25:05,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2fedd33d >2013-12-09 13:25:10,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: aeef201 >2013-12-09 13:25:10,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: aeef201 >2013-12-09 13:25:10,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71daef5b >2013-12-09 13:25:10,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71daef5b >2013-12-09 13:25:15,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 581d7a43 >2013-12-09 13:25:16,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 581d7a43 >2013-12-09 13:25:16,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 410f228c >2013-12-09 13:25:16,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 410f228c >2013-12-09 13:25:21,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 249b188f >2013-12-09 13:25:22,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 249b188f >2013-12-09 13:25:22,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45dbb7ca >2013-12-09 13:25:22,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45dbb7ca >2013-12-09 13:25:27,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: abcbe74 >2013-12-09 13:25:27,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: abcbe74 >2013-12-09 13:25:27,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73c1b06 >2013-12-09 13:25:28,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73c1b06 >2013-12-09 13:25:33,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7609a776 >2013-12-09 13:25:33,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7609a776 >2013-12-09 13:25:33,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 720a21f0 >2013-12-09 13:25:33,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 720a21f0 >2013-12-09 13:25:38,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 575c4443 >2013-12-09 13:25:39,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 575c4443 >2013-12-09 13:25:39,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69654cc4 >2013-12-09 13:25:39,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69654cc4 >2013-12-09 13:25:43,960 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-57) No up server in cluster >2013-12-09 13:25:43,960 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-57) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:25:43,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4731a688 >2013-12-09 13:25:44,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4731a688 >2013-12-09 13:25:44,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d8c4959 >2013-12-09 13:25:45,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d8c4959 >2013-12-09 13:25:45,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6aee3d3b >2013-12-09 13:25:45,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6aee3d3b >2013-12-09 13:25:50,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f6cf8a5 >2013-12-09 13:25:50,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f6cf8a5 >2013-12-09 13:25:50,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d6e1037 >2013-12-09 13:25:51,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d6e1037 >2013-12-09 13:25:56,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e4b2471 >2013-12-09 13:25:56,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e4b2471 >2013-12-09 13:25:56,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35b56fc >2013-12-09 13:25:56,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35b56fc >2013-12-09 13:26:02,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6623fdb >2013-12-09 13:26:02,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6623fdb >2013-12-09 13:26:02,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f4848d7 >2013-12-09 13:26:02,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f4848d7 >2013-12-09 13:26:07,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 485579d7 >2013-12-09 13:26:08,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 485579d7 >2013-12-09 13:26:08,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59f528e3 >2013-12-09 13:26:08,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59f528e3 >2013-12-09 13:26:13,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 422c0d54 >2013-12-09 13:26:14,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 422c0d54 >2013-12-09 13:26:14,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b1f1152 >2013-12-09 13:26:14,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b1f1152 >2013-12-09 13:26:19,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66feaa12 >2013-12-09 13:26:19,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 66feaa12 >2013-12-09 13:26:19,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 270e2b47 >2013-12-09 13:26:20,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 270e2b47 >2013-12-09 13:26:25,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c3a62c2 >2013-12-09 13:26:25,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c3a62c2 >2013-12-09 13:26:25,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7165cb06 >2013-12-09 13:26:25,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7165cb06 >2013-12-09 13:26:30,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8813ac8 >2013-12-09 13:26:31,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 8813ac8 >2013-12-09 13:26:31,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3bdcd8aa >2013-12-09 13:26:31,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3bdcd8aa >2013-12-09 13:26:36,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2398cb >2013-12-09 13:26:37,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2398cb >2013-12-09 13:26:37,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 584566b8 >2013-12-09 13:26:37,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 584566b8 >2013-12-09 13:26:42,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2dfa6e95 >2013-12-09 13:26:42,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2dfa6e95 >2013-12-09 13:26:42,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37b5409 >2013-12-09 13:26:43,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37b5409 >2013-12-09 13:26:44,247 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-29) No up server in cluster >2013-12-09 13:26:44,247 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-29) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:26:44,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67ad74e8 >2013-12-09 13:26:44,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterTasksListVDSCommand, return: [], log id: 67ad74e8 >2013-12-09 13:26:48,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b6fd8b5 >2013-12-09 13:26:48,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b6fd8b5 >2013-12-09 13:26:48,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ea9f6da >2013-12-09 13:26:49,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ea9f6da >2013-12-09 13:26:54,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59a04cf8 >2013-12-09 13:26:54,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59a04cf8 >2013-12-09 13:26:54,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 736e86b3 >2013-12-09 13:26:54,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 736e86b3 >2013-12-09 13:26:59,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63c4cc8c >2013-12-09 13:27:00,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 63c4cc8c >2013-12-09 13:27:00,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46c86ba5 >2013-12-09 13:27:00,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46c86ba5 >2013-12-09 13:27:05,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ef4a859 >2013-12-09 13:27:06,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7ef4a859 >2013-12-09 13:27:06,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10b45739 >2013-12-09 13:27:06,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10b45739 >2013-12-09 13:27:11,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2abd659f >2013-12-09 13:27:11,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2abd659f >2013-12-09 13:27:11,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b5ce566 >2013-12-09 13:27:12,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b5ce566 >2013-12-09 13:27:17,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e509b76 >2013-12-09 13:27:17,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e509b76 >2013-12-09 13:27:17,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a6c6578 >2013-12-09 13:27:17,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a6c6578 >2013-12-09 13:27:22,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54b92ac8 >2013-12-09 13:27:23,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 54b92ac8 >2013-12-09 13:27:23,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: fadb406 >2013-12-09 13:27:23,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: fadb406 >2013-12-09 13:27:28,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d49f566 >2013-12-09 13:27:29,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d49f566 >2013-12-09 13:27:29,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10c1321b >2013-12-09 13:27:29,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10c1321b >2013-12-09 13:27:34,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73ab79f2 >2013-12-09 13:27:34,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 73ab79f2 >2013-12-09 13:27:34,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a118c1 >2013-12-09 13:27:35,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a118c1 >2013-12-09 13:27:40,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 574be6e7 >2013-12-09 13:27:40,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 574be6e7 >2013-12-09 13:27:40,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6433d957 >2013-12-09 13:27:41,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6433d957 >2013-12-09 13:27:44,535 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-59) No up server in cluster >2013-12-09 13:27:44,536 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-59) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:27:44,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ace3138 >2013-12-09 13:27:44,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3ace3138 >2013-12-09 13:27:46,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55e8dd94 >2013-12-09 13:27:46,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 55e8dd94 >2013-12-09 13:27:46,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6914e412 >2013-12-09 13:27:46,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6914e412 >2013-12-09 13:27:51,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3dc0dd29 >2013-12-09 13:27:52,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3dc0dd29 >2013-12-09 13:27:52,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d739820 >2013-12-09 13:27:52,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d739820 >2013-12-09 13:27:57,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b31ad3a >2013-12-09 13:27:58,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: b31ad3a >2013-12-09 13:27:58,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62f1b147 >2013-12-09 13:27:58,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62f1b147 >2013-12-09 13:28:03,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f755505 >2013-12-09 13:28:03,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f755505 >2013-12-09 13:28:03,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f3603fd >2013-12-09 13:28:04,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f3603fd >2013-12-09 13:28:09,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27a28294 >2013-12-09 13:28:09,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 27a28294 >2013-12-09 13:28:09,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e50f93a >2013-12-09 13:28:09,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e50f93a >2013-12-09 13:28:14,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f283d91 >2013-12-09 13:28:15,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3f283d91 >2013-12-09 13:28:15,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32fd1f88 >2013-12-09 13:28:15,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32fd1f88 >2013-12-09 13:28:20,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e4f2141 >2013-12-09 13:28:21,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7e4f2141 >2013-12-09 13:28:21,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35056f19 >2013-12-09 13:28:21,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35056f19 >2013-12-09 13:28:26,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57cb841 >2013-12-09 13:28:26,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 57cb841 >2013-12-09 13:28:26,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f296ad4 >2013-12-09 13:28:27,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f296ad4 >2013-12-09 13:28:32,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3659658c >2013-12-09 13:28:32,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3659658c >2013-12-09 13:28:32,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12f67be2 >2013-12-09 13:28:33,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12f67be2 >2013-12-09 13:28:38,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6cd3d18d >2013-12-09 13:28:38,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6cd3d18d >2013-12-09 13:28:38,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16571631 >2013-12-09 13:28:38,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16571631 >2013-12-09 13:28:43,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 474d96b6 >2013-12-09 13:28:44,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 474d96b6 >2013-12-09 13:28:44,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11eeacaa >2013-12-09 13:28:44,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11eeacaa >2013-12-09 13:28:44,824 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-62) No up server in cluster >2013-12-09 13:28:44,824 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-62) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:28:44,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: bec1786 >2013-12-09 13:28:45,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterTasksListVDSCommand, return: [], log id: bec1786 >2013-12-09 13:28:49,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25ab443d >2013-12-09 13:28:50,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 25ab443d >2013-12-09 13:28:50,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36ddf87d >2013-12-09 13:28:50,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36ddf87d >2013-12-09 13:28:55,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46de2af >2013-12-09 13:28:55,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 46de2af >2013-12-09 13:28:55,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79497de7 >2013-12-09 13:28:56,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79497de7 >2013-12-09 13:29:01,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1acc6dee >2013-12-09 13:29:01,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1acc6dee >2013-12-09 13:29:01,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e4c6f76 >2013-12-09 13:29:01,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e4c6f76 >2013-12-09 13:29:06,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4593b58d >2013-12-09 13:29:07,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4593b58d >2013-12-09 13:29:07,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5cead702 >2013-12-09 13:29:07,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cead702 >2013-12-09 13:29:12,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1cba0a42 >2013-12-09 13:29:13,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1cba0a42 >2013-12-09 13:29:13,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 655027f4 >2013-12-09 13:29:13,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 655027f4 >2013-12-09 13:29:18,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11b766b2 >2013-12-09 13:29:19,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 11b766b2 >2013-12-09 13:29:19,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 96f651a >2013-12-09 13:29:19,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 96f651a >2013-12-09 13:29:24,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32a87a01 >2013-12-09 13:29:24,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 32a87a01 >2013-12-09 13:29:24,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d92414a >2013-12-09 13:29:25,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d92414a >2013-12-09 13:29:30,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f398fad >2013-12-09 13:29:30,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f398fad >2013-12-09 13:29:30,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c86f1f2 >2013-12-09 13:29:30,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c86f1f2 >2013-12-09 13:29:35,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58b2c5c9 >2013-12-09 13:29:36,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 58b2c5c9 >2013-12-09 13:29:36,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f887d5e >2013-12-09 13:29:36,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f887d5e >2013-12-09 13:29:41,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 142c8a96 >2013-12-09 13:29:42,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 142c8a96 >2013-12-09 13:29:42,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 588349b4 >2013-12-09 13:29:42,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 588349b4 >2013-12-09 13:29:45,100 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-63) No up server in cluster >2013-12-09 13:29:45,100 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-63) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:29:45,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2803bdd2 >2013-12-09 13:29:45,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2803bdd2 >2013-12-09 13:29:47,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3fcd9bd3 >2013-12-09 13:29:47,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3fcd9bd3 >2013-12-09 13:29:47,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5633c655 >2013-12-09 13:29:48,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5633c655 >2013-12-09 13:29:53,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 298e668 >2013-12-09 13:29:53,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 298e668 >2013-12-09 13:29:53,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4daa16f0 >2013-12-09 13:29:53,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4daa16f0 >2013-12-09 13:29:58,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 124ae155 >2013-12-09 13:29:59,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 124ae155 >2013-12-09 13:29:59,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a98289c >2013-12-09 13:29:59,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a98289c >2013-12-09 13:30:04,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d0552d4 >2013-12-09 13:30:05,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d0552d4 >2013-12-09 13:30:05,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 120732e1 >2013-12-09 13:30:05,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 120732e1 >2013-12-09 13:30:10,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b33d9c9 >2013-12-09 13:30:10,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3b33d9c9 >2013-12-09 13:30:10,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54b0f80 >2013-12-09 13:30:11,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54b0f80 >2013-12-09 13:30:16,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ea8ad68 >2013-12-09 13:30:16,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1ea8ad68 >2013-12-09 13:30:16,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6765c5eb >2013-12-09 13:30:16,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6765c5eb >2013-12-09 13:30:22,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7546c59d >2013-12-09 13:30:22,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7546c59d >2013-12-09 13:30:22,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6291f68f >2013-12-09 13:30:22,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6291f68f >2013-12-09 13:30:27,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35e41ef3 >2013-12-09 13:30:28,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 35e41ef3 >2013-12-09 13:30:28,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41243df4 >2013-12-09 13:30:28,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41243df4 >2013-12-09 13:30:33,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2750c5c0 >2013-12-09 13:30:34,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2750c5c0 >2013-12-09 13:30:34,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17266b32 >2013-12-09 13:30:34,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17266b32 >2013-12-09 13:30:39,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 775b7ee4 >2013-12-09 13:30:39,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 775b7ee4 >2013-12-09 13:30:39,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a20bbca >2013-12-09 13:30:40,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a20bbca >2013-12-09 13:30:45,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5be5dc1f >2013-12-09 13:30:45,399 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-5) No up server in cluster >2013-12-09 13:30:45,399 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-5) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:30:45,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4cebb91 >2013-12-09 13:30:45,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5be5dc1f >2013-12-09 13:30:45,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 417f0a07 >2013-12-09 13:30:45,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4cebb91 >2013-12-09 13:30:45,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 417f0a07 >2013-12-09 13:30:50,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16a58133 >2013-12-09 13:30:51,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 16a58133 >2013-12-09 13:30:51,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74a38b44 >2013-12-09 13:30:51,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74a38b44 >2013-12-09 13:30:56,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1dc4682d >2013-12-09 13:30:57,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1dc4682d >2013-12-09 13:30:57,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 495ac708 >2013-12-09 13:30:57,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 495ac708 >2013-12-09 13:31:02,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 292240d0 >2013-12-09 13:31:02,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 292240d0 >2013-12-09 13:31:02,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44034c16 >2013-12-09 13:31:03,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44034c16 >2013-12-09 13:31:08,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1064e8a >2013-12-09 13:31:08,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1064e8a >2013-12-09 13:31:08,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ed51fb >2013-12-09 13:31:08,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ed51fb >2013-12-09 13:31:13,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19a4d34a >2013-12-09 13:31:14,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 19a4d34a >2013-12-09 13:31:14,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c915aa2 >2013-12-09 13:31:14,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c915aa2 >2013-12-09 13:31:19,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c2f1353 >2013-12-09 13:31:20,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c2f1353 >2013-12-09 13:31:20,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1bb28477 >2013-12-09 13:31:20,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1bb28477 >2013-12-09 13:31:25,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: fbea771 >2013-12-09 13:31:26,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: fbea771 >2013-12-09 13:31:26,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f2bd943 >2013-12-09 13:31:26,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f2bd943 >2013-12-09 13:31:31,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a55edb4 >2013-12-09 13:31:31,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4a55edb4 >2013-12-09 13:31:31,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c5a72b9 >2013-12-09 13:31:32,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c5a72b9 >2013-12-09 13:31:37,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 602f61a7 >2013-12-09 13:31:37,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 602f61a7 >2013-12-09 13:31:37,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35aa47f5 >2013-12-09 13:31:37,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35aa47f5 >2013-12-09 13:31:42,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2904586f >2013-12-09 13:31:43,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2904586f >2013-12-09 13:31:43,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e22ee8c >2013-12-09 13:31:43,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e22ee8c >2013-12-09 13:31:45,650 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-73) No up server in cluster >2013-12-09 13:31:45,651 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-73) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:31:45,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59c45379 >2013-12-09 13:31:45,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterTasksListVDSCommand, return: [], log id: 59c45379 >2013-12-09 13:31:48,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3669877e >2013-12-09 13:31:49,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3669877e >2013-12-09 13:31:49,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3873216e >2013-12-09 13:31:49,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3873216e >2013-12-09 13:31:54,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2459bfb5 >2013-12-09 13:31:54,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2459bfb5 >2013-12-09 13:31:54,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6aeb81e1 >2013-12-09 13:31:55,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6aeb81e1 >2013-12-09 13:32:00,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 44722931 >2013-12-09 13:32:00,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 44722931 >2013-12-09 13:32:00,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f0147c5 >2013-12-09 13:32:01,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f0147c5 >2013-12-09 13:32:06,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29d262a >2013-12-09 13:32:06,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 29d262a >2013-12-09 13:32:06,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e0ddd21 >2013-12-09 13:32:06,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e0ddd21 >2013-12-09 13:32:11,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54d08e71 >2013-12-09 13:32:12,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 54d08e71 >2013-12-09 13:32:12,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1247d604 >2013-12-09 13:32:12,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1247d604 >2013-12-09 13:32:17,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a5709d9 >2013-12-09 13:32:18,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a5709d9 >2013-12-09 13:32:18,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e4bcf55 >2013-12-09 13:32:18,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e4bcf55 >2013-12-09 13:32:23,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20799a96 >2013-12-09 13:32:23,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 20799a96 >2013-12-09 13:32:23,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42ffea6e >2013-12-09 13:32:24,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42ffea6e >2013-12-09 13:32:29,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d7672b5 >2013-12-09 13:32:29,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d7672b5 >2013-12-09 13:32:29,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70e933d5 >2013-12-09 13:32:29,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70e933d5 >2013-12-09 13:32:34,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37a74e99 >2013-12-09 13:32:35,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 37a74e99 >2013-12-09 13:32:35,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 795e353 >2013-12-09 13:32:35,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 795e353 >2013-12-09 13:32:40,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 470de928 >2013-12-09 13:32:41,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 470de928 >2013-12-09 13:32:41,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5493815c >2013-12-09 13:32:41,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5493815c >2013-12-09 13:32:45,939 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-53) No up server in cluster >2013-12-09 13:32:45,939 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-53) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:32:45,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 759853a7 >2013-12-09 13:32:46,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterTasksListVDSCommand, return: [], log id: 759853a7 >2013-12-09 13:32:46,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54bda841 >2013-12-09 13:32:47,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 54bda841 >2013-12-09 13:32:47,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 438587d2 >2013-12-09 13:32:47,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 438587d2 >2013-12-09 13:32:52,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a9faee3 >2013-12-09 13:32:52,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2a9faee3 >2013-12-09 13:32:52,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70638e5 >2013-12-09 13:32:53,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70638e5 >2013-12-09 13:32:58,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 472ee1ef >2013-12-09 13:32:58,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 472ee1ef >2013-12-09 13:32:58,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d467d65 >2013-12-09 13:32:58,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d467d65 >2013-12-09 13:33:03,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 356b16d0 >2013-12-09 13:33:04,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 356b16d0 >2013-12-09 13:33:04,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3cbf1ec6 >2013-12-09 13:33:04,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3cbf1ec6 >2013-12-09 13:33:09,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a00cc44 >2013-12-09 13:33:10,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2a00cc44 >2013-12-09 13:33:10,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 667b103 >2013-12-09 13:33:10,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 667b103 >2013-12-09 13:33:15,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b0397c3 >2013-12-09 13:33:15,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3b0397c3 >2013-12-09 13:33:15,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d2c2448 >2013-12-09 13:33:16,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d2c2448 >2013-12-09 13:33:21,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53897085 >2013-12-09 13:33:21,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 53897085 >2013-12-09 13:33:21,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e20c910 >2013-12-09 13:33:22,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e20c910 >2013-12-09 13:33:27,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ce361ef >2013-12-09 13:33:27,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5ce361ef >2013-12-09 13:33:27,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48a921a8 >2013-12-09 13:33:27,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48a921a8 >2013-12-09 13:33:32,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 596ddb57 >2013-12-09 13:33:33,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 596ddb57 >2013-12-09 13:33:33,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 507a4f62 >2013-12-09 13:33:33,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 507a4f62 >2013-12-09 13:33:38,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68221cc1 >2013-12-09 13:33:39,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 68221cc1 >2013-12-09 13:33:39,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d7236b2 >2013-12-09 13:33:39,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d7236b2 >2013-12-09 13:33:44,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70addc26 >2013-12-09 13:33:44,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 70addc26 >2013-12-09 13:33:44,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3765d4a5 >2013-12-09 13:33:45,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3765d4a5 >2013-12-09 13:33:46,306 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2013-12-09 13:33:46,306 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:33:46,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59bc643f >2013-12-09 13:33:46,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterTasksListVDSCommand, return: [], log id: 59bc643f >2013-12-09 13:33:50,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2927156a >2013-12-09 13:33:50,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2927156a >2013-12-09 13:33:50,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21762a40 >2013-12-09 13:33:50,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21762a40 >2013-12-09 13:33:55,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56bb1ef >2013-12-09 13:33:56,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 56bb1ef >2013-12-09 13:33:56,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b595279 >2013-12-09 13:33:56,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b595279 >2013-12-09 13:34:01,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16306922 >2013-12-09 13:34:02,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 16306922 >2013-12-09 13:34:02,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ab997bd >2013-12-09 13:34:02,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ab997bd >2013-12-09 13:34:07,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30f11653 >2013-12-09 13:34:08,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 30f11653 >2013-12-09 13:34:08,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 154d779c >2013-12-09 13:34:08,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 154d779c >2013-12-09 13:34:13,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f6c5ab8 >2013-12-09 13:34:13,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f6c5ab8 >2013-12-09 13:34:13,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 262a2aa5 >2013-12-09 13:34:14,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 262a2aa5 >2013-12-09 13:34:19,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 292e1ba >2013-12-09 13:34:19,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 292e1ba >2013-12-09 13:34:19,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2544a714 >2013-12-09 13:34:19,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2544a714 >2013-12-09 13:34:24,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38be064 >2013-12-09 13:34:25,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 38be064 >2013-12-09 13:34:25,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72ed0eeb >2013-12-09 13:34:25,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72ed0eeb >2013-12-09 13:34:30,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a788351 >2013-12-09 13:34:31,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6a788351 >2013-12-09 13:34:31,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5fc5dd28 >2013-12-09 13:34:31,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fc5dd28 >2013-12-09 13:34:36,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d1bf2d8 >2013-12-09 13:34:36,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d1bf2d8 >2013-12-09 13:34:36,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: fd97963 >2013-12-09 13:34:37,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: fd97963 >2013-12-09 13:34:42,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 866605e >2013-12-09 13:34:42,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 866605e >2013-12-09 13:34:42,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 165e6551 >2013-12-09 13:34:43,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 165e6551 >2013-12-09 13:34:46,597 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-61) No up server in cluster >2013-12-09 13:34:46,597 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-61) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:34:46,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e25e2c1 >2013-12-09 13:34:46,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2e25e2c1 >2013-12-09 13:34:48,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2333ee22 >2013-12-09 13:34:48,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2333ee22 >2013-12-09 13:34:48,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: acefafa >2013-12-09 13:34:48,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: acefafa >2013-12-09 13:34:53,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c953d1b >2013-12-09 13:34:54,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6c953d1b >2013-12-09 13:34:54,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56b2b26e >2013-12-09 13:34:54,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56b2b26e >2013-12-09 13:34:59,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37df007f >2013-12-09 13:35:00,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 37df007f >2013-12-09 13:35:00,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 283fb9c3 >2013-12-09 13:35:00,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 283fb9c3 >2013-12-09 13:35:05,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76e98278 >2013-12-09 13:35:05,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 76e98278 >2013-12-09 13:35:05,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c071917 >2013-12-09 13:35:06,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c071917 >2013-12-09 13:35:11,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e6b2b4e >2013-12-09 13:35:11,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e6b2b4e >2013-12-09 13:35:11,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b21dd34 >2013-12-09 13:35:11,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b21dd34 >2013-12-09 13:35:16,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58b26576 >2013-12-09 13:35:17,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 58b26576 >2013-12-09 13:35:17,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23bdde5f >2013-12-09 13:35:17,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23bdde5f >2013-12-09 13:35:22,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 133bc288 >2013-12-09 13:35:23,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 133bc288 >2013-12-09 13:35:23,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 211dd6f9 >2013-12-09 13:35:23,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 211dd6f9 >2013-12-09 13:35:28,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26da2ceb >2013-12-09 13:35:28,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 26da2ceb >2013-12-09 13:35:28,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d181655 >2013-12-09 13:35:29,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d181655 >2013-12-09 13:35:34,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 366d6f6e >2013-12-09 13:35:34,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 366d6f6e >2013-12-09 13:35:34,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2980df8d >2013-12-09 13:35:34,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2980df8d >2013-12-09 13:35:39,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ff58a43 >2013-12-09 13:35:40,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ff58a43 >2013-12-09 13:35:40,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 235414e2 >2013-12-09 13:35:40,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 235414e2 >2013-12-09 13:35:45,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e595b8b >2013-12-09 13:35:46,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: e595b8b >2013-12-09 13:35:46,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7cb944d3 >2013-12-09 13:35:46,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7cb944d3 >2013-12-09 13:35:46,863 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-20) No up server in cluster >2013-12-09 13:35:46,863 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-20) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:35:46,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73a4b5c1 >2013-12-09 13:35:47,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterTasksListVDSCommand, return: [], log id: 73a4b5c1 >2013-12-09 13:35:51,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3536b335 >2013-12-09 13:35:52,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3536b335 >2013-12-09 13:35:52,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ef1c56b >2013-12-09 13:35:52,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ef1c56b >2013-12-09 13:35:57,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b286358 >2013-12-09 13:35:57,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b286358 >2013-12-09 13:35:57,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d3c1d2d >2013-12-09 13:35:58,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d3c1d2d >2013-12-09 13:36:03,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59a24fc0 >2013-12-09 13:36:03,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 59a24fc0 >2013-12-09 13:36:03,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29d8bdde >2013-12-09 13:36:03,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29d8bdde >2013-12-09 13:36:08,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5725abc5 >2013-12-09 13:36:09,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5725abc5 >2013-12-09 13:36:09,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 675b5622 >2013-12-09 13:36:09,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 675b5622 >2013-12-09 13:36:14,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41eccf21 >2013-12-09 13:36:15,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 41eccf21 >2013-12-09 13:36:15,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d39731e >2013-12-09 13:36:15,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d39731e >2013-12-09 13:36:20,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 772628ef >2013-12-09 13:36:20,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 772628ef >2013-12-09 13:36:20,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f946d98 >2013-12-09 13:36:21,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f946d98 >2013-12-09 13:36:26,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48a80175 >2013-12-09 13:36:26,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 48a80175 >2013-12-09 13:36:26,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41dbfbc9 >2013-12-09 13:36:27,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41dbfbc9 >2013-12-09 13:36:32,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75e62e1b >2013-12-09 13:36:32,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 75e62e1b >2013-12-09 13:36:32,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d7d47b4 >2013-12-09 13:36:32,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d7d47b4 >2013-12-09 13:36:37,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ed299e1 >2013-12-09 13:36:38,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ed299e1 >2013-12-09 13:36:38,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44c6f4a5 >2013-12-09 13:36:38,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44c6f4a5 >2013-12-09 13:36:43,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c72382 >2013-12-09 13:36:44,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c72382 >2013-12-09 13:36:44,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43b53df5 >2013-12-09 13:36:44,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43b53df5 >2013-12-09 13:36:47,147 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-31) No up server in cluster >2013-12-09 13:36:47,148 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-31) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:36:47,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7165abc8 >2013-12-09 13:36:47,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7165abc8 >2013-12-09 13:36:49,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13770623 >2013-12-09 13:36:49,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 13770623 >2013-12-09 13:36:49,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c82fd62 >2013-12-09 13:36:50,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c82fd62 >2013-12-09 13:36:55,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 313f4dc2 >2013-12-09 13:36:55,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 313f4dc2 >2013-12-09 13:36:55,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79916067 >2013-12-09 13:36:55,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79916067 >2013-12-09 13:37:00,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27817aa0 >2013-12-09 13:37:01,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 27817aa0 >2013-12-09 13:37:01,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 226242d9 >2013-12-09 13:37:01,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 226242d9 >2013-12-09 13:37:06,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25f7a885 >2013-12-09 13:37:07,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 25f7a885 >2013-12-09 13:37:07,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35d0a943 >2013-12-09 13:37:07,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35d0a943 >2013-12-09 13:37:12,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: cec1eaa >2013-12-09 13:37:12,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: cec1eaa >2013-12-09 13:37:12,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d201578 >2013-12-09 13:37:13,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d201578 >2013-12-09 13:37:18,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13ce2046 >2013-12-09 13:37:18,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 13ce2046 >2013-12-09 13:37:18,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76dbcfd2 >2013-12-09 13:37:18,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76dbcfd2 >2013-12-09 13:37:24,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d98de17 >2013-12-09 13:37:24,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d98de17 >2013-12-09 13:37:24,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ab6b5dc >2013-12-09 13:37:24,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ab6b5dc >2013-12-09 13:37:29,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: fa936d4 >2013-12-09 13:37:30,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: fa936d4 >2013-12-09 13:37:30,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15343012 >2013-12-09 13:37:30,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15343012 >2013-12-09 13:37:35,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46c386b5 >2013-12-09 13:37:36,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 46c386b5 >2013-12-09 13:37:36,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3eecf745 >2013-12-09 13:37:36,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3eecf745 >2013-12-09 13:37:41,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f8830d >2013-12-09 13:37:41,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f8830d >2013-12-09 13:37:41,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13eb4b16 >2013-12-09 13:37:42,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13eb4b16 >2013-12-09 13:37:47,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e1a73c5 >2013-12-09 13:37:47,433 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-4) No up server in cluster >2013-12-09 13:37:47,433 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-4) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:37:47,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26c739d3 >2013-12-09 13:37:47,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3e1a73c5 >2013-12-09 13:37:47,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6804d3bf >2013-12-09 13:37:47,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterTasksListVDSCommand, return: [], log id: 26c739d3 >2013-12-09 13:37:47,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6804d3bf >2013-12-09 13:37:52,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34332bf9 >2013-12-09 13:37:53,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 34332bf9 >2013-12-09 13:37:53,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b629418 >2013-12-09 13:37:53,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b629418 >2013-12-09 13:37:58,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 473bd643 >2013-12-09 13:37:59,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 473bd643 >2013-12-09 13:37:59,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46c7a216 >2013-12-09 13:37:59,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46c7a216 >2013-12-09 13:38:04,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26067f10 >2013-12-09 13:38:04,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 26067f10 >2013-12-09 13:38:04,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3bb3b8b >2013-12-09 13:38:05,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3bb3b8b >2013-12-09 13:38:10,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b96dc41 >2013-12-09 13:38:10,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b96dc41 >2013-12-09 13:38:10,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5027df9c >2013-12-09 13:38:10,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5027df9c >2013-12-09 13:38:15,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 171373fa >2013-12-09 13:38:16,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 171373fa >2013-12-09 13:38:16,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 566371b7 >2013-12-09 13:38:16,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 566371b7 >2013-12-09 13:38:21,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 258e1f1 >2013-12-09 13:38:22,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 258e1f1 >2013-12-09 13:38:22,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5fd95d80 >2013-12-09 13:38:22,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fd95d80 >2013-12-09 13:38:27,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4eed1ad >2013-12-09 13:38:28,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4eed1ad >2013-12-09 13:38:28,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e0d81e9 >2013-12-09 13:38:28,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e0d81e9 >2013-12-09 13:38:33,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c83e4f7 >2013-12-09 13:38:33,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3c83e4f7 >2013-12-09 13:38:33,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b0be42e >2013-12-09 13:38:34,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b0be42e >2013-12-09 13:38:39,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3587c8e1 >2013-12-09 13:38:39,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3587c8e1 >2013-12-09 13:38:39,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c23541c >2013-12-09 13:38:39,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c23541c >2013-12-09 13:38:44,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27d35ae7 >2013-12-09 13:38:45,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 27d35ae7 >2013-12-09 13:38:45,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 697afc59 >2013-12-09 13:38:45,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 697afc59 >2013-12-09 13:38:47,691 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-69) No up server in cluster >2013-12-09 13:38:47,691 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-69) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:38:47,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61a69ed4 >2013-12-09 13:38:47,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterTasksListVDSCommand, return: [], log id: 61a69ed4 >2013-12-09 13:38:50,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20da62dc >2013-12-09 13:38:51,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 20da62dc >2013-12-09 13:38:51,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f9a459c >2013-12-09 13:38:51,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f9a459c >2013-12-09 13:38:56,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c80682c >2013-12-09 13:38:56,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1c80682c >2013-12-09 13:38:56,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45371fc1 >2013-12-09 13:38:57,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45371fc1 >2013-12-09 13:39:02,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d812344 >2013-12-09 13:39:02,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d812344 >2013-12-09 13:39:02,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 717189c3 >2013-12-09 13:39:02,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 717189c3 >2013-12-09 13:39:08,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 28a263a7 >2013-12-09 13:39:08,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 28a263a7 >2013-12-09 13:39:08,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 605d9f4d >2013-12-09 13:39:08,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 605d9f4d >2013-12-09 13:39:13,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f9bfc46 >2013-12-09 13:39:14,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f9bfc46 >2013-12-09 13:39:14,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1aed5893 >2013-12-09 13:39:14,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1aed5893 >2013-12-09 13:39:19,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1014a6ab >2013-12-09 13:39:20,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1014a6ab >2013-12-09 13:39:20,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a649b61 >2013-12-09 13:39:20,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a649b61 >2013-12-09 13:39:25,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d9aeb17 >2013-12-09 13:39:25,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6d9aeb17 >2013-12-09 13:39:25,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15738aa7 >2013-12-09 13:39:26,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15738aa7 >2013-12-09 13:39:31,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ecdf6a2 >2013-12-09 13:39:31,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ecdf6a2 >2013-12-09 13:39:31,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76c2a68 >2013-12-09 13:39:31,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76c2a68 >2013-12-09 13:39:36,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2cce0817 >2013-12-09 13:39:37,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2cce0817 >2013-12-09 13:39:37,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3bb5bfec >2013-12-09 13:39:37,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3bb5bfec >2013-12-09 13:39:42,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47ad3217 >2013-12-09 13:39:43,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 47ad3217 >2013-12-09 13:39:43,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4756b71e >2013-12-09 13:39:43,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4756b71e >2013-12-09 13:39:47,970 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-49) No up server in cluster >2013-12-09 13:39:47,970 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-49) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:39:47,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 106e6a81 >2013-12-09 13:39:48,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterTasksListVDSCommand, return: [], log id: 106e6a81 >2013-12-09 13:39:48,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a69979d >2013-12-09 13:39:48,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: a69979d >2013-12-09 13:39:48,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4338503b >2013-12-09 13:39:49,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4338503b >2013-12-09 13:39:54,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c363f65 >2013-12-09 13:39:54,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c363f65 >2013-12-09 13:39:54,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d4a3bd8 >2013-12-09 13:39:54,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d4a3bd8 >2013-12-09 13:39:59,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1747f95e >2013-12-09 13:40:00,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1747f95e >2013-12-09 13:40:00,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42245aec >2013-12-09 13:40:00,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42245aec >2013-12-09 13:40:05,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27d581a1 >2013-12-09 13:40:06,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 27d581a1 >2013-12-09 13:40:06,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e76fc4b >2013-12-09 13:40:06,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e76fc4b >2013-12-09 13:40:11,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45e61922 >2013-12-09 13:40:12,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 45e61922 >2013-12-09 13:40:12,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47b793c1 >2013-12-09 13:40:12,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47b793c1 >2013-12-09 13:40:17,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 467fee30 >2013-12-09 13:40:17,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 467fee30 >2013-12-09 13:40:17,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5cd8aa28 >2013-12-09 13:40:18,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cd8aa28 >2013-12-09 13:40:23,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c0772a3 >2013-12-09 13:40:23,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7c0772a3 >2013-12-09 13:40:23,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1561e151 >2013-12-09 13:40:23,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1561e151 >2013-12-09 13:40:28,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ab4434a >2013-12-09 13:40:29,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5ab4434a >2013-12-09 13:40:29,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a20da0b >2013-12-09 13:40:29,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a20da0b >2013-12-09 13:40:34,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34a50f >2013-12-09 13:40:35,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 34a50f >2013-12-09 13:40:35,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1937166c >2013-12-09 13:40:35,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1937166c >2013-12-09 13:40:40,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bc0de6d >2013-12-09 13:40:40,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4bc0de6d >2013-12-09 13:40:40,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c1efb3b >2013-12-09 13:40:41,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c1efb3b >2013-12-09 13:40:46,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b2ec979 >2013-12-09 13:40:46,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: b2ec979 >2013-12-09 13:40:46,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16f2d8f7 >2013-12-09 13:40:46,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16f2d8f7 >2013-12-09 13:40:48,258 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-25) No up server in cluster >2013-12-09 13:40:48,258 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-25) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:40:48,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78ea25ea >2013-12-09 13:40:48,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterTasksListVDSCommand, return: [], log id: 78ea25ea >2013-12-09 13:40:51,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c46a39e >2013-12-09 13:40:52,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c46a39e >2013-12-09 13:40:52,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1677bd40 >2013-12-09 13:40:52,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1677bd40 >2013-12-09 13:40:57,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3adfd46 >2013-12-09 13:40:58,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3adfd46 >2013-12-09 13:40:58,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2192be91 >2013-12-09 13:40:58,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2192be91 >2013-12-09 13:41:03,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a711cf9 >2013-12-09 13:41:03,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2a711cf9 >2013-12-09 13:41:03,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ea9262e >2013-12-09 13:41:04,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ea9262e >2013-12-09 13:41:09,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: aa0cf15 >2013-12-09 13:41:09,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: aa0cf15 >2013-12-09 13:41:09,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2bfdbc3b >2013-12-09 13:41:10,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bfdbc3b >2013-12-09 13:41:15,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6fbb3034 >2013-12-09 13:41:15,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6fbb3034 >2013-12-09 13:41:15,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7dcd820b >2013-12-09 13:41:15,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7dcd820b >2013-12-09 13:41:20,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37d13963 >2013-12-09 13:41:21,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 37d13963 >2013-12-09 13:41:21,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41cd31c4 >2013-12-09 13:41:21,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41cd31c4 >2013-12-09 13:41:26,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38b84a0e >2013-12-09 13:41:27,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 38b84a0e >2013-12-09 13:41:27,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c355719 >2013-12-09 13:41:27,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c355719 >2013-12-09 13:41:32,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14f45a64 >2013-12-09 13:41:32,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 14f45a64 >2013-12-09 13:41:32,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 168ec5e5 >2013-12-09 13:41:33,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 168ec5e5 >2013-12-09 13:41:38,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d1fb0b8 >2013-12-09 13:41:38,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d1fb0b8 >2013-12-09 13:41:38,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a63cf38 >2013-12-09 13:41:38,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a63cf38 >2013-12-09 13:41:43,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7cc366d4 >2013-12-09 13:41:44,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7cc366d4 >2013-12-09 13:41:44,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f53f505 >2013-12-09 13:41:44,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f53f505 >2013-12-09 13:41:48,538 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-14) No up server in cluster >2013-12-09 13:41:48,538 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-14) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:41:48,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d00b4d8 >2013-12-09 13:41:48,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5d00b4d8 >2013-12-09 13:41:49,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 285e374c >2013-12-09 13:41:50,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 285e374c >2013-12-09 13:41:50,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30945afc >2013-12-09 13:41:50,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30945afc >2013-12-09 13:41:55,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2754a6ca >2013-12-09 13:41:55,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2754a6ca >2013-12-09 13:41:55,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3802e2db >2013-12-09 13:41:56,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3802e2db >2013-12-09 13:42:01,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 401d847b >2013-12-09 13:42:01,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 401d847b >2013-12-09 13:42:01,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ac5e23 >2013-12-09 13:42:01,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ac5e23 >2013-12-09 13:42:06,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 28f95bb7 >2013-12-09 13:42:07,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 28f95bb7 >2013-12-09 13:42:07,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30f7c62d >2013-12-09 13:42:07,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30f7c62d >2013-12-09 13:42:12,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 726c0723 >2013-12-09 13:42:13,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 726c0723 >2013-12-09 13:42:13,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 200beb65 >2013-12-09 13:42:13,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 200beb65 >2013-12-09 13:42:18,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1bb96d1f >2013-12-09 13:42:19,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1bb96d1f >2013-12-09 13:42:19,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27403848 >2013-12-09 13:42:19,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27403848 >2013-12-09 13:42:24,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e9f6870 >2013-12-09 13:42:24,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3e9f6870 >2013-12-09 13:42:24,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5dc9b21 >2013-12-09 13:42:25,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5dc9b21 >2013-12-09 13:42:30,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 364a247f >2013-12-09 13:42:30,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 364a247f >2013-12-09 13:42:30,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19f974f3 >2013-12-09 13:42:30,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19f974f3 >2013-12-09 13:42:35,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 166019aa >2013-12-09 13:42:36,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 166019aa >2013-12-09 13:42:36,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47b5d749 >2013-12-09 13:42:36,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47b5d749 >2013-12-09 13:42:41,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c5c5573 >2013-12-09 13:42:42,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c5c5573 >2013-12-09 13:42:42,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 253e2ed3 >2013-12-09 13:42:42,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 253e2ed3 >2013-12-09 13:42:47,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68115aa1 >2013-12-09 13:42:48,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 68115aa1 >2013-12-09 13:42:48,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5adc6b55 >2013-12-09 13:42:48,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5adc6b55 >2013-12-09 13:42:48,824 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-45) No up server in cluster >2013-12-09 13:42:48,824 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-45) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:42:48,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70631402 >2013-12-09 13:42:49,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterTasksListVDSCommand, return: [], log id: 70631402 >2013-12-09 13:42:53,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3232b739 >2013-12-09 13:42:53,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3232b739 >2013-12-09 13:42:53,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5282d5b8 >2013-12-09 13:42:54,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5282d5b8 >2013-12-09 13:42:59,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5405874c >2013-12-09 13:42:59,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5405874c >2013-12-09 13:42:59,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 545d879 >2013-12-09 13:42:59,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 545d879 >2013-12-09 13:43:04,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f8f93c6 >2013-12-09 13:43:05,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f8f93c6 >2013-12-09 13:43:05,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6dcaf77e >2013-12-09 13:43:05,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6dcaf77e >2013-12-09 13:43:10,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4277b8d2 >2013-12-09 13:43:11,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4277b8d2 >2013-12-09 13:43:11,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f8e589e >2013-12-09 13:43:11,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f8e589e >2013-12-09 13:43:16,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12a86dca >2013-12-09 13:43:16,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 12a86dca >2013-12-09 13:43:16,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21b74a77 >2013-12-09 13:43:17,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21b74a77 >2013-12-09 13:43:22,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1191d772 >2013-12-09 13:43:22,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1191d772 >2013-12-09 13:43:22,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23afaf09 >2013-12-09 13:43:22,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23afaf09 >2013-12-09 13:43:27,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 695459e8 >2013-12-09 13:43:28,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 695459e8 >2013-12-09 13:43:28,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52da0dfb >2013-12-09 13:43:28,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52da0dfb >2013-12-09 13:43:33,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51fbde1 >2013-12-09 13:43:34,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 51fbde1 >2013-12-09 13:43:34,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4971b40b >2013-12-09 13:43:34,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4971b40b >2013-12-09 13:43:39,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: cb658ec >2013-12-09 13:43:39,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: cb658ec >2013-12-09 13:43:39,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 634e3fb6 >2013-12-09 13:43:40,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 634e3fb6 >2013-12-09 13:43:45,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c5bead6 >2013-12-09 13:43:45,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c5bead6 >2013-12-09 13:43:45,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1df644e0 >2013-12-09 13:43:46,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1df644e0 >2013-12-09 13:43:49,098 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-94) No up server in cluster >2013-12-09 13:43:49,099 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-94) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:43:49,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: aedac4b >2013-12-09 13:43:49,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterTasksListVDSCommand, return: [], log id: aedac4b >2013-12-09 13:43:51,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c75c284 >2013-12-09 13:43:51,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c75c284 >2013-12-09 13:43:51,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41addef4 >2013-12-09 13:43:51,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41addef4 >2013-12-09 13:43:56,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 582c0ddb >2013-12-09 13:43:57,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 582c0ddb >2013-12-09 13:43:57,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f51674a >2013-12-09 13:43:57,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f51674a >2013-12-09 13:44:02,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5011b30c >2013-12-09 13:44:03,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5011b30c >2013-12-09 13:44:03,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77ab6f83 >2013-12-09 13:44:03,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77ab6f83 >2013-12-09 13:44:08,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 512af7fb >2013-12-09 13:44:08,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 512af7fb >2013-12-09 13:44:08,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b7676d2 >2013-12-09 13:44:09,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b7676d2 >2013-12-09 13:44:14,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e3f22c >2013-12-09 13:44:14,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4e3f22c >2013-12-09 13:44:14,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 216f3a1c >2013-12-09 13:44:14,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 216f3a1c >2013-12-09 13:44:19,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c7ac742 >2013-12-09 13:44:20,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1c7ac742 >2013-12-09 13:44:20,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6af19a5d >2013-12-09 13:44:20,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6af19a5d >2013-12-09 13:44:25,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b1e9b73 >2013-12-09 13:44:26,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6b1e9b73 >2013-12-09 13:44:26,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b755562 >2013-12-09 13:44:26,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b755562 >2013-12-09 13:44:31,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7851dae0 >2013-12-09 13:44:32,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7851dae0 >2013-12-09 13:44:32,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40009bc8 >2013-12-09 13:44:32,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40009bc8 >2013-12-09 13:44:37,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 303121ad >2013-12-09 13:44:37,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 303121ad >2013-12-09 13:44:37,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e2d42e9 >2013-12-09 13:44:38,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e2d42e9 >2013-12-09 13:44:43,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5186661c >2013-12-09 13:44:43,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5186661c >2013-12-09 13:44:43,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5928904a >2013-12-09 13:44:43,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5928904a >2013-12-09 13:44:48,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 663d4e41 >2013-12-09 13:44:49,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 663d4e41 >2013-12-09 13:44:49,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ddd8e49 >2013-12-09 13:44:49,367 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-100) No up server in cluster >2013-12-09 13:44:49,368 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-100) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:44:49,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6efb4ea5 >2013-12-09 13:44:49,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ddd8e49 >2013-12-09 13:44:49,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6efb4ea5 >2013-12-09 13:44:54,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ee77882 >2013-12-09 13:44:55,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3ee77882 >2013-12-09 13:44:55,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 659513d2 >2013-12-09 13:44:55,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 659513d2 >2013-12-09 13:45:00,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: acca947 >2013-12-09 13:45:00,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: acca947 >2013-12-09 13:45:00,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35ffa4ed >2013-12-09 13:45:01,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35ffa4ed >2013-12-09 13:45:06,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e76dc0e >2013-12-09 13:45:06,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1e76dc0e >2013-12-09 13:45:06,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 388f4dca >2013-12-09 13:45:06,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 388f4dca >2013-12-09 13:45:11,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c4e37d1 >2013-12-09 13:45:12,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3c4e37d1 >2013-12-09 13:45:12,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7da80bff >2013-12-09 13:45:12,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7da80bff >2013-12-09 13:45:17,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2031c40f >2013-12-09 13:45:18,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2031c40f >2013-12-09 13:45:18,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26bbb9a1 >2013-12-09 13:45:18,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26bbb9a1 >2013-12-09 13:45:23,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20db1d97 >2013-12-09 13:45:23,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 20db1d97 >2013-12-09 13:45:23,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12d011c6 >2013-12-09 13:45:24,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12d011c6 >2013-12-09 13:45:29,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1dce21bb >2013-12-09 13:45:29,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1dce21bb >2013-12-09 13:45:29,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66b04cd2 >2013-12-09 13:45:29,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66b04cd2 >2013-12-09 13:45:35,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9e556fa >2013-12-09 13:45:35,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 9e556fa >2013-12-09 13:45:35,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6bef63b >2013-12-09 13:45:35,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6bef63b >2013-12-09 13:45:40,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 738cd064 >2013-12-09 13:45:41,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 738cd064 >2013-12-09 13:45:41,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1401a051 >2013-12-09 13:45:41,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1401a051 >2013-12-09 13:45:46,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5220bd29 >2013-12-09 13:45:47,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5220bd29 >2013-12-09 13:45:47,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d5828c2 >2013-12-09 13:45:47,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d5828c2 >2013-12-09 13:45:49,624 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-95) No up server in cluster >2013-12-09 13:45:49,624 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-95) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:45:49,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d5fd77c >2013-12-09 13:45:49,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5d5fd77c >2013-12-09 13:45:52,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ea6054d >2013-12-09 13:45:52,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7ea6054d >2013-12-09 13:45:52,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56b96e0f >2013-12-09 13:45:53,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56b96e0f >2013-12-09 13:45:58,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18226a5f >2013-12-09 13:45:58,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 18226a5f >2013-12-09 13:45:58,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 306e665f >2013-12-09 13:45:58,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 306e665f >2013-12-09 13:46:03,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e8d9c46 >2013-12-09 13:46:04,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3e8d9c46 >2013-12-09 13:46:04,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c0cd82f >2013-12-09 13:46:04,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c0cd82f >2013-12-09 13:46:09,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3aa56cb0 >2013-12-09 13:46:10,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3aa56cb0 >2013-12-09 13:46:10,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3cc1480b >2013-12-09 13:46:10,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3cc1480b >2013-12-09 13:46:15,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a2d2db2 >2013-12-09 13:46:15,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3a2d2db2 >2013-12-09 13:46:15,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6eb612dc >2013-12-09 13:46:16,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6eb612dc >2013-12-09 13:46:21,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 629fe745 >2013-12-09 13:46:21,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 629fe745 >2013-12-09 13:46:21,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15ba75ba >2013-12-09 13:46:21,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15ba75ba >2013-12-09 13:46:26,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2185f4d0 >2013-12-09 13:46:27,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2185f4d0 >2013-12-09 13:46:27,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51b360eb >2013-12-09 13:46:27,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51b360eb >2013-12-09 13:46:32,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4aa4265c >2013-12-09 13:46:33,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4aa4265c >2013-12-09 13:46:33,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20ad3a29 >2013-12-09 13:46:33,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20ad3a29 >2013-12-09 13:46:38,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7fb6db5f >2013-12-09 13:46:39,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7fb6db5f >2013-12-09 13:46:39,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ea91e19 >2013-12-09 13:46:39,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ea91e19 >2013-12-09 13:46:44,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f72d81b >2013-12-09 13:46:44,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f72d81b >2013-12-09 13:46:44,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4368963f >2013-12-09 13:46:45,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4368963f >2013-12-09 13:46:49,906 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-92) No up server in cluster >2013-12-09 13:46:49,906 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-92) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:46:49,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c5c258d >2013-12-09 13:46:50,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5284e1a8 >2013-12-09 13:46:50,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterTasksListVDSCommand, return: [], log id: c5c258d >2013-12-09 13:46:50,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5284e1a8 >2013-12-09 13:46:50,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47234340 >2013-12-09 13:46:50,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47234340 >2013-12-09 13:46:55,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16c11ccb >2013-12-09 13:46:56,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 16c11ccb >2013-12-09 13:46:56,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c497c77 >2013-12-09 13:46:56,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c497c77 >2013-12-09 13:47:01,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a28294c >2013-12-09 13:47:02,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a28294c >2013-12-09 13:47:02,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3aa2f947 >2013-12-09 13:47:02,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3aa2f947 >2013-12-09 13:47:07,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75b36a6c >2013-12-09 13:47:07,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 75b36a6c >2013-12-09 13:47:07,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 403044ae >2013-12-09 13:47:08,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 403044ae >2013-12-09 13:47:13,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10b7cd06 >2013-12-09 13:47:13,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 10b7cd06 >2013-12-09 13:47:13,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47c72b3e >2013-12-09 13:47:13,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47c72b3e >2013-12-09 13:47:18,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ba552b5 >2013-12-09 13:47:19,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7ba552b5 >2013-12-09 13:47:19,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 588ad74f >2013-12-09 13:47:19,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 588ad74f >2013-12-09 13:47:24,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b4bbd83 >2013-12-09 13:47:25,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4b4bbd83 >2013-12-09 13:47:25,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 680af229 >2013-12-09 13:47:25,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 680af229 >2013-12-09 13:47:30,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7cd29cbb >2013-12-09 13:47:31,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7cd29cbb >2013-12-09 13:47:31,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f43d000 >2013-12-09 13:47:31,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f43d000 >2013-12-09 13:47:36,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28ac9736 >2013-12-09 13:47:36,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 28ac9736 >2013-12-09 13:47:36,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a24171b >2013-12-09 13:47:37,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a24171b >2013-12-09 13:47:42,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a8c183e >2013-12-09 13:47:42,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3a8c183e >2013-12-09 13:47:42,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5cf586a6 >2013-12-09 13:47:42,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cf586a6 >2013-12-09 13:47:47,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ed9de20 >2013-12-09 13:47:48,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ed9de20 >2013-12-09 13:47:48,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 531ce700 >2013-12-09 13:47:48,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 531ce700 >2013-12-09 13:47:50,182 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-46) No up server in cluster >2013-12-09 13:47:50,182 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-46) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:47:50,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41f63f35 >2013-12-09 13:47:50,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterTasksListVDSCommand, return: [], log id: 41f63f35 >2013-12-09 13:47:53,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 295e10b >2013-12-09 13:47:54,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 295e10b >2013-12-09 13:47:54,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 690f83a5 >2013-12-09 13:47:54,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 690f83a5 >2013-12-09 13:47:59,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2624f29c >2013-12-09 13:47:59,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2624f29c >2013-12-09 13:47:59,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ed14d4c >2013-12-09 13:48:00,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ed14d4c >2013-12-09 13:48:05,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 504d971a >2013-12-09 13:48:05,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 504d971a >2013-12-09 13:48:05,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d98ddac >2013-12-09 13:48:05,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d98ddac >2013-12-09 13:48:10,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ac7833f >2013-12-09 13:48:11,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ac7833f >2013-12-09 13:48:11,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ed3594a >2013-12-09 13:48:11,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ed3594a >2013-12-09 13:48:16,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a953d8b >2013-12-09 13:48:17,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4a953d8b >2013-12-09 13:48:17,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 405eedf3 >2013-12-09 13:48:17,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 405eedf3 >2013-12-09 13:48:22,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c241758 >2013-12-09 13:48:23,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c241758 >2013-12-09 13:48:23,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37a10596 >2013-12-09 13:48:23,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37a10596 >2013-12-09 13:48:28,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f6a603 >2013-12-09 13:48:28,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1f6a603 >2013-12-09 13:48:28,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3289cd53 >2013-12-09 13:48:29,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3289cd53 >2013-12-09 13:48:34,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d20fb4 >2013-12-09 13:48:34,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d20fb4 >2013-12-09 13:48:34,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 653ed198 >2013-12-09 13:48:34,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 653ed198 >2013-12-09 13:48:39,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75288194 >2013-12-09 13:48:40,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 75288194 >2013-12-09 13:48:40,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 276200a7 >2013-12-09 13:48:40,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 276200a7 >2013-12-09 13:48:45,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 239103e2 >2013-12-09 13:48:46,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 239103e2 >2013-12-09 13:48:46,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 22b41795 >2013-12-09 13:48:46,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22b41795 >2013-12-09 13:48:50,459 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-37) No up server in cluster >2013-12-09 13:48:50,459 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-37) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:48:50,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 384bdfc8 >2013-12-09 13:48:50,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterTasksListVDSCommand, return: [], log id: 384bdfc8 >2013-12-09 13:48:51,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 373a11b0 >2013-12-09 13:48:51,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 373a11b0 >2013-12-09 13:48:52,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d1cd2a3 >2013-12-09 13:48:52,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d1cd2a3 >2013-12-09 13:48:57,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56f76699 >2013-12-09 13:48:57,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 56f76699 >2013-12-09 13:48:57,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3051b14f >2013-12-09 13:48:58,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3051b14f >2013-12-09 13:49:03,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b97bc0e >2013-12-09 13:49:03,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b97bc0e >2013-12-09 13:49:03,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a11379b >2013-12-09 13:49:03,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a11379b >2013-12-09 13:49:08,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3de0515c >2013-12-09 13:49:09,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3de0515c >2013-12-09 13:49:09,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3433ed42 >2013-12-09 13:49:09,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3433ed42 >2013-12-09 13:49:14,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5136c229 >2013-12-09 13:49:15,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5136c229 >2013-12-09 13:49:15,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a094252 >2013-12-09 13:49:15,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a094252 >2013-12-09 13:49:20,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f742387 >2013-12-09 13:49:20,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5f742387 >2013-12-09 13:49:20,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 633114a5 >2013-12-09 13:49:21,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 633114a5 >2013-12-09 13:49:26,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3993454b >2013-12-09 13:49:26,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3993454b >2013-12-09 13:49:26,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 417ffdbe >2013-12-09 13:49:26,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 417ffdbe >2013-12-09 13:49:31,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3475ce3d >2013-12-09 13:49:32,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3475ce3d >2013-12-09 13:49:32,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49c4bac9 >2013-12-09 13:49:32,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49c4bac9 >2013-12-09 13:49:37,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61cde320 >2013-12-09 13:49:38,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 61cde320 >2013-12-09 13:49:38,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e648cdc >2013-12-09 13:49:38,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e648cdc >2013-12-09 13:49:43,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 519b6e0 >2013-12-09 13:49:44,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 519b6e0 >2013-12-09 13:49:44,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3bdbf282 >2013-12-09 13:49:44,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3bdbf282 >2013-12-09 13:49:49,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52de0704 >2013-12-09 13:49:49,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 52de0704 >2013-12-09 13:49:49,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61144327 >2013-12-09 13:49:50,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61144327 >2013-12-09 13:49:50,747 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-19) No up server in cluster >2013-12-09 13:49:50,747 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-19) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:49:50,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75b34057 >2013-12-09 13:49:51,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterTasksListVDSCommand, return: [], log id: 75b34057 >2013-12-09 13:49:55,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 619056b >2013-12-09 13:49:55,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 619056b >2013-12-09 13:49:55,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74db607b >2013-12-09 13:49:55,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74db607b >2013-12-09 13:50:00,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: df0cc6e >2013-12-09 13:50:01,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: df0cc6e >2013-12-09 13:50:01,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a1ef022 >2013-12-09 13:50:01,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a1ef022 >2013-12-09 13:50:06,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7325b5f4 >2013-12-09 13:50:07,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7325b5f4 >2013-12-09 13:50:07,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20bd9e34 >2013-12-09 13:50:07,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20bd9e34 >2013-12-09 13:50:12,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ae732c4 >2013-12-09 13:50:12,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ae732c4 >2013-12-09 13:50:12,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: be840e4 >2013-12-09 13:50:13,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: be840e4 >2013-12-09 13:50:18,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d191fc >2013-12-09 13:50:18,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2d191fc >2013-12-09 13:50:18,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7314cff3 >2013-12-09 13:50:18,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7314cff3 >2013-12-09 13:50:23,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8859672 >2013-12-09 13:50:24,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 8859672 >2013-12-09 13:50:24,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64b59f74 >2013-12-09 13:50:24,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64b59f74 >2013-12-09 13:50:29,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b713716 >2013-12-09 13:50:30,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3b713716 >2013-12-09 13:50:30,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 619155e2 >2013-12-09 13:50:30,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 619155e2 >2013-12-09 13:50:35,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a266c7a >2013-12-09 13:50:36,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a266c7a >2013-12-09 13:50:36,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ea04658 >2013-12-09 13:50:36,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ea04658 >2013-12-09 13:50:41,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b26930d >2013-12-09 13:50:41,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: b26930d >2013-12-09 13:50:41,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 266c6287 >2013-12-09 13:50:42,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 266c6287 >2013-12-09 13:50:47,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 483039a7 >2013-12-09 13:50:47,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 483039a7 >2013-12-09 13:50:47,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4add490b >2013-12-09 13:50:47,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4add490b >2013-12-09 13:50:51,032 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-68) No up server in cluster >2013-12-09 13:50:51,032 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-68) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:50:51,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d519fa3 >2013-12-09 13:50:51,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7d519fa3 >2013-12-09 13:50:52,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3092db0d >2013-12-09 13:50:53,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3092db0d >2013-12-09 13:50:53,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7452dc59 >2013-12-09 13:50:53,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7452dc59 >2013-12-09 13:50:58,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42813832 >2013-12-09 13:50:59,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42813832 >2013-12-09 13:50:59,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f00915 >2013-12-09 13:50:59,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f00915 >2013-12-09 13:51:04,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 714d9337 >2013-12-09 13:51:04,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 714d9337 >2013-12-09 13:51:04,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 419afc5c >2013-12-09 13:51:05,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 419afc5c >2013-12-09 13:51:10,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31849148 >2013-12-09 13:51:10,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 31849148 >2013-12-09 13:51:10,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27044d2e >2013-12-09 13:51:10,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27044d2e >2013-12-09 13:51:15,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27e8fb53 >2013-12-09 13:51:16,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 27e8fb53 >2013-12-09 13:51:16,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f193796 >2013-12-09 13:51:16,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f193796 >2013-12-09 13:51:21,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e304425 >2013-12-09 13:51:22,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e304425 >2013-12-09 13:51:22,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 593ca863 >2013-12-09 13:51:22,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 593ca863 >2013-12-09 13:51:27,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48b0643f >2013-12-09 13:51:28,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 48b0643f >2013-12-09 13:51:28,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 312991b2 >2013-12-09 13:51:28,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 312991b2 >2013-12-09 13:51:33,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a010b35 >2013-12-09 13:51:33,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a010b35 >2013-12-09 13:51:33,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 797a80cc >2013-12-09 13:51:34,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 797a80cc >2013-12-09 13:51:39,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62614d90 >2013-12-09 13:51:39,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 62614d90 >2013-12-09 13:51:39,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18af1a66 >2013-12-09 13:51:39,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18af1a66 >2013-12-09 13:51:44,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6522cf95 >2013-12-09 13:51:45,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6522cf95 >2013-12-09 13:51:45,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13b2b8ce >2013-12-09 13:51:45,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13b2b8ce >2013-12-09 13:51:50,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 682b4f8e >2013-12-09 13:51:51,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 682b4f8e >2013-12-09 13:51:51,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c9ae4aa >2013-12-09 13:51:51,317 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-25) No up server in cluster >2013-12-09 13:51:51,317 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-25) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:51:51,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b7e9c4a >2013-12-09 13:51:51,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c9ae4aa >2013-12-09 13:51:51,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4b7e9c4a >2013-12-09 13:51:56,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b46d822 >2013-12-09 13:51:57,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5b46d822 >2013-12-09 13:51:57,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a23a047 >2013-12-09 13:51:57,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a23a047 >2013-12-09 13:52:02,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 538fb558 >2013-12-09 13:52:02,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 538fb558 >2013-12-09 13:52:02,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 438998ff >2013-12-09 13:52:03,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 438998ff >2013-12-09 13:52:08,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39b31fc5 >2013-12-09 13:52:08,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 39b31fc5 >2013-12-09 13:52:08,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a82193b >2013-12-09 13:52:08,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a82193b >2013-12-09 13:52:13,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28cc115d >2013-12-09 13:52:14,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 28cc115d >2013-12-09 13:52:14,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 765cabf2 >2013-12-09 13:52:14,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 765cabf2 >2013-12-09 13:52:19,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1712efb0 >2013-12-09 13:52:20,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1712efb0 >2013-12-09 13:52:20,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e93b04f >2013-12-09 13:52:20,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e93b04f >2013-12-09 13:52:25,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 728c5def >2013-12-09 13:52:25,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 728c5def >2013-12-09 13:52:25,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a435b75 >2013-12-09 13:52:26,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a435b75 >2013-12-09 13:52:31,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52ffe35a >2013-12-09 13:52:31,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 52ffe35a >2013-12-09 13:52:31,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33de3ea6 >2013-12-09 13:52:32,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33de3ea6 >2013-12-09 13:52:37,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 929e232 >2013-12-09 13:52:37,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 929e232 >2013-12-09 13:52:37,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17ba7f4d >2013-12-09 13:52:37,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17ba7f4d >2013-12-09 13:52:42,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7240ca66 >2013-12-09 13:52:43,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7240ca66 >2013-12-09 13:52:43,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ec91bb3 >2013-12-09 13:52:43,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ec91bb3 >2013-12-09 13:52:48,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f862701 >2013-12-09 13:52:49,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f862701 >2013-12-09 13:52:49,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ecbdfbb >2013-12-09 13:52:49,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ecbdfbb >2013-12-09 13:52:51,578 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-6) No up server in cluster >2013-12-09 13:52:51,578 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-6) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:52:51,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 575e2e37 >2013-12-09 13:52:52,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterTasksListVDSCommand, return: [], log id: 575e2e37 >2013-12-09 13:52:54,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3593e36f >2013-12-09 13:52:54,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3593e36f >2013-12-09 13:52:54,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 744d9c56 >2013-12-09 13:52:55,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 744d9c56 >2013-12-09 13:53:00,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48c37268 >2013-12-09 13:53:00,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 48c37268 >2013-12-09 13:53:00,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5735fa81 >2013-12-09 13:53:00,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5735fa81 >2013-12-09 13:53:05,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76e2fcfe >2013-12-09 13:53:06,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 76e2fcfe >2013-12-09 13:53:06,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62116e6d >2013-12-09 13:53:06,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62116e6d >2013-12-09 13:53:11,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f32f696 >2013-12-09 13:53:12,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f32f696 >2013-12-09 13:53:12,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c645f3f >2013-12-09 13:53:12,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c645f3f >2013-12-09 13:53:17,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e2e63a7 >2013-12-09 13:53:17,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3e2e63a7 >2013-12-09 13:53:17,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f9d6367 >2013-12-09 13:53:18,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f9d6367 >2013-12-09 13:53:23,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 137bca18 >2013-12-09 13:53:23,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 137bca18 >2013-12-09 13:53:23,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7cfa365c >2013-12-09 13:53:24,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7cfa365c >2013-12-09 13:53:29,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 431387b6 >2013-12-09 13:53:29,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 431387b6 >2013-12-09 13:53:29,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2340aab0 >2013-12-09 13:53:29,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2340aab0 >2013-12-09 13:53:34,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19b0b704 >2013-12-09 13:53:35,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 19b0b704 >2013-12-09 13:53:35,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5408fba0 >2013-12-09 13:53:35,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5408fba0 >2013-12-09 13:53:40,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6fa4b13d >2013-12-09 13:53:41,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6fa4b13d >2013-12-09 13:53:41,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75bc6ee3 >2013-12-09 13:53:41,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75bc6ee3 >2013-12-09 13:53:46,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 219b793d >2013-12-09 13:53:46,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 219b793d >2013-12-09 13:53:46,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57d0fde4 >2013-12-09 13:53:47,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57d0fde4 >2013-12-09 13:53:52,021 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-57) No up server in cluster >2013-12-09 13:53:52,021 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-57) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:53:52,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 590a3466 >2013-12-09 13:53:52,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fae7632 >2013-12-09 13:53:52,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterTasksListVDSCommand, return: [], log id: 590a3466 >2013-12-09 13:53:52,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2fae7632 >2013-12-09 13:53:52,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23814ce4 >2013-12-09 13:53:52,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23814ce4 >2013-12-09 13:53:57,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 617ac59a >2013-12-09 13:53:58,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 617ac59a >2013-12-09 13:53:58,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44c8e39b >2013-12-09 13:53:58,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44c8e39b >2013-12-09 13:54:03,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4035db44 >2013-12-09 13:54:04,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4035db44 >2013-12-09 13:54:04,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77345c76 >2013-12-09 13:54:04,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77345c76 >2013-12-09 13:54:09,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31062332 >2013-12-09 13:54:09,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 31062332 >2013-12-09 13:54:09,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40749228 >2013-12-09 13:54:10,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40749228 >2013-12-09 13:54:15,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a867241 >2013-12-09 13:54:15,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a867241 >2013-12-09 13:54:15,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f636026 >2013-12-09 13:54:15,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f636026 >2013-12-09 13:54:21,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f139a9f >2013-12-09 13:54:21,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: f139a9f >2013-12-09 13:54:21,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c438932 >2013-12-09 13:54:21,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c438932 >2013-12-09 13:54:26,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c598b8f >2013-12-09 13:54:27,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c598b8f >2013-12-09 13:54:27,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4fc45089 >2013-12-09 13:54:27,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fc45089 >2013-12-09 13:54:32,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13a95368 >2013-12-09 13:54:33,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 13a95368 >2013-12-09 13:54:33,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d20e4c4 >2013-12-09 13:54:33,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d20e4c4 >2013-12-09 13:54:38,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7cf91ca0 >2013-12-09 13:54:38,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7cf91ca0 >2013-12-09 13:54:38,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d0195cd >2013-12-09 13:54:39,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d0195cd >2013-12-09 13:54:44,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f91ec36 >2013-12-09 13:54:44,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f91ec36 >2013-12-09 13:54:44,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d8c837b >2013-12-09 13:54:44,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d8c837b >2013-12-09 13:54:49,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2bce5d8b >2013-12-09 13:54:50,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2bce5d8b >2013-12-09 13:54:50,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19864ba7 >2013-12-09 13:54:50,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19864ba7 >2013-12-09 13:54:52,272 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-11) No up server in cluster >2013-12-09 13:54:52,272 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-11) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:54:52,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7560e385 >2013-12-09 13:54:52,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7560e385 >2013-12-09 13:54:55,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 22437cdc >2013-12-09 13:54:56,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 22437cdc >2013-12-09 13:54:56,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d36a3df >2013-12-09 13:54:56,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d36a3df >2013-12-09 13:55:01,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 498b19d2 >2013-12-09 13:55:01,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 498b19d2 >2013-12-09 13:55:01,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12498df3 >2013-12-09 13:55:02,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12498df3 >2013-12-09 13:55:07,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3257ad15 >2013-12-09 13:55:07,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3257ad15 >2013-12-09 13:55:07,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56956841 >2013-12-09 13:55:07,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56956841 >2013-12-09 13:55:13,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53d782ae >2013-12-09 13:55:13,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 53d782ae >2013-12-09 13:55:13,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7db2d0c4 >2013-12-09 13:55:13,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7db2d0c4 >2013-12-09 13:55:18,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24689c97 >2013-12-09 13:55:19,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 24689c97 >2013-12-09 13:55:19,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39ad5e41 >2013-12-09 13:55:19,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39ad5e41 >2013-12-09 13:55:24,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c6ccca0 >2013-12-09 13:55:25,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c6ccca0 >2013-12-09 13:55:25,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62c843eb >2013-12-09 13:55:25,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62c843eb >2013-12-09 13:55:30,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e454706 >2013-12-09 13:55:30,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e454706 >2013-12-09 13:55:30,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11e7a8c4 >2013-12-09 13:55:31,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11e7a8c4 >2013-12-09 13:55:36,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ebfc8ff >2013-12-09 13:55:36,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2ebfc8ff >2013-12-09 13:55:36,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3433298b >2013-12-09 13:55:36,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3433298b >2013-12-09 13:55:41,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 266b8ac8 >2013-12-09 13:55:42,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 266b8ac8 >2013-12-09 13:55:42,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65cb5da7 >2013-12-09 13:55:42,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65cb5da7 >2013-12-09 13:55:47,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 335207ed >2013-12-09 13:55:48,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 335207ed >2013-12-09 13:55:48,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c75e308 >2013-12-09 13:55:48,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c75e308 >2013-12-09 13:55:52,567 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-93) No up server in cluster >2013-12-09 13:55:52,567 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-93) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:55:52,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 559267d9 >2013-12-09 13:55:52,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterTasksListVDSCommand, return: [], log id: 559267d9 >2013-12-09 13:55:53,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c971125 >2013-12-09 13:55:53,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c971125 >2013-12-09 13:55:53,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3af3d2bc >2013-12-09 13:55:54,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3af3d2bc >2013-12-09 13:55:59,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6432bb43 >2013-12-09 13:55:59,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6432bb43 >2013-12-09 13:55:59,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67c2ed9d >2013-12-09 13:55:59,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67c2ed9d >2013-12-09 13:56:05,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68ab6659 >2013-12-09 13:56:05,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 68ab6659 >2013-12-09 13:56:05,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b00a50b >2013-12-09 13:56:05,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b00a50b >2013-12-09 13:56:10,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e39696d >2013-12-09 13:56:11,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e39696d >2013-12-09 13:56:11,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49d08686 >2013-12-09 13:56:11,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49d08686 >2013-12-09 13:56:16,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5316cde2 >2013-12-09 13:56:17,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5316cde2 >2013-12-09 13:56:17,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 218bcdda >2013-12-09 13:56:17,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 218bcdda >2013-12-09 13:56:22,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c8c7e3d >2013-12-09 13:56:22,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3c8c7e3d >2013-12-09 13:56:22,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ae71fc0 >2013-12-09 13:56:23,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ae71fc0 >2013-12-09 13:56:28,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6636b7fd >2013-12-09 13:56:28,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6636b7fd >2013-12-09 13:56:28,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71f323b1 >2013-12-09 13:56:28,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71f323b1 >2013-12-09 13:56:33,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 371cf721 >2013-12-09 13:56:34,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 371cf721 >2013-12-09 13:56:34,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 633a65a4 >2013-12-09 13:56:34,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 633a65a4 >2013-12-09 13:56:39,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1565edbb >2013-12-09 13:56:40,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1565edbb >2013-12-09 13:56:40,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1dbde8b0 >2013-12-09 13:56:40,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1dbde8b0 >2013-12-09 13:56:45,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 209bf6f6 >2013-12-09 13:56:45,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 209bf6f6 >2013-12-09 13:56:45,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4313ea61 >2013-12-09 13:56:46,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4313ea61 >2013-12-09 13:56:51,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c6b0122 >2013-12-09 13:56:51,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c6b0122 >2013-12-09 13:56:51,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 25904965 >2013-12-09 13:56:51,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25904965 >2013-12-09 13:56:52,839 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-82) No up server in cluster >2013-12-09 13:56:52,839 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-82) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:56:52,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3bdd473e >2013-12-09 13:56:53,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3bdd473e >2013-12-09 13:56:56,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b72c75a >2013-12-09 13:56:57,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b72c75a >2013-12-09 13:56:57,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ed0c100 >2013-12-09 13:56:57,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ed0c100 >2013-12-09 13:57:02,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21d2c8d4 >2013-12-09 13:57:03,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 21d2c8d4 >2013-12-09 13:57:03,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4af705ad >2013-12-09 13:57:03,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4af705ad >2013-12-09 13:57:08,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3393c965 >2013-12-09 13:57:09,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3393c965 >2013-12-09 13:57:09,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a82a3b2 >2013-12-09 13:57:09,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a82a3b2 >2013-12-09 13:57:14,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c86ad4b >2013-12-09 13:57:14,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6c86ad4b >2013-12-09 13:57:14,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b390df >2013-12-09 13:57:15,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b390df >2013-12-09 13:57:20,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c2bd8a1 >2013-12-09 13:57:20,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c2bd8a1 >2013-12-09 13:57:20,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ac68c2d >2013-12-09 13:57:20,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ac68c2d >2013-12-09 13:57:25,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59d6ab0 >2013-12-09 13:57:26,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59d6ab0 >2013-12-09 13:57:26,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54036200 >2013-12-09 13:57:26,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54036200 >2013-12-09 13:57:31,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37f33c5c >2013-12-09 13:57:32,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 37f33c5c >2013-12-09 13:57:32,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 672d9721 >2013-12-09 13:57:32,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 672d9721 >2013-12-09 13:57:37,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ca954ee >2013-12-09 13:57:37,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5ca954ee >2013-12-09 13:57:37,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65566c9d >2013-12-09 13:57:38,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65566c9d >2013-12-09 13:57:43,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 789f27fd >2013-12-09 13:57:43,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 789f27fd >2013-12-09 13:57:43,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f224f77 >2013-12-09 13:57:43,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f224f77 >2013-12-09 13:57:48,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2bafe443 >2013-12-09 13:57:49,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2bafe443 >2013-12-09 13:57:49,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ff9abf1 >2013-12-09 13:57:49,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ff9abf1 >2013-12-09 13:57:53,112 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-92) No up server in cluster >2013-12-09 13:57:53,112 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-92) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:57:53,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f9126ab >2013-12-09 13:57:53,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2f9126ab >2013-12-09 13:57:54,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52c539ba >2013-12-09 13:57:55,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 52c539ba >2013-12-09 13:57:55,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6fbd907 >2013-12-09 13:57:55,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6fbd907 >2013-12-09 13:58:00,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 207cd4d0 >2013-12-09 13:58:01,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 207cd4d0 >2013-12-09 13:58:01,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c7cf171 >2013-12-09 13:58:01,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c7cf171 >2013-12-09 13:58:06,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ed17c29 >2013-12-09 13:58:06,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ed17c29 >2013-12-09 13:58:06,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43cbabe9 >2013-12-09 13:58:07,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43cbabe9 >2013-12-09 13:58:12,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26133bf7 >2013-12-09 13:58:12,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 26133bf7 >2013-12-09 13:58:12,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f8b90f7 >2013-12-09 13:58:12,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f8b90f7 >2013-12-09 13:58:17,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e2a7f46 >2013-12-09 13:58:18,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7e2a7f46 >2013-12-09 13:58:18,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 258a8d12 >2013-12-09 13:58:18,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 258a8d12 >2013-12-09 13:58:23,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3552f00 >2013-12-09 13:58:24,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3552f00 >2013-12-09 13:58:24,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 747899f2 >2013-12-09 13:58:24,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 747899f2 >2013-12-09 13:58:29,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37952b18 >2013-12-09 13:58:29,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 37952b18 >2013-12-09 13:58:29,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3de3d46 >2013-12-09 13:58:30,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3de3d46 >2013-12-09 13:58:35,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ab0eb93 >2013-12-09 13:58:35,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2ab0eb93 >2013-12-09 13:58:35,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f85657 >2013-12-09 13:58:35,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f85657 >2013-12-09 13:58:40,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75a31a40 >2013-12-09 13:58:41,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 75a31a40 >2013-12-09 13:58:41,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d6c4495 >2013-12-09 13:58:41,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d6c4495 >2013-12-09 13:58:46,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b80edde >2013-12-09 13:58:47,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: b80edde >2013-12-09 13:58:47,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: fbd3c46 >2013-12-09 13:58:47,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: fbd3c46 >2013-12-09 13:58:52,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c009573 >2013-12-09 13:58:53,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4c009573 >2013-12-09 13:58:53,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ae29700 >2013-12-09 13:58:53,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ae29700 >2013-12-09 13:58:53,385 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-81) No up server in cluster >2013-12-09 13:58:53,386 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-81) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:58:53,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f608001 >2013-12-09 13:58:53,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6f608001 >2013-12-09 13:58:58,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2df5de43 >2013-12-09 13:58:58,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2df5de43 >2013-12-09 13:58:58,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d4e5f59 >2013-12-09 13:58:59,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d4e5f59 >2013-12-09 13:59:04,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73ba489e >2013-12-09 13:59:04,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 73ba489e >2013-12-09 13:59:04,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b8dc99a >2013-12-09 13:59:04,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b8dc99a >2013-12-09 13:59:09,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2da62a91 >2013-12-09 13:59:10,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2da62a91 >2013-12-09 13:59:10,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c91921d >2013-12-09 13:59:10,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c91921d >2013-12-09 13:59:15,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47c3e694 >2013-12-09 13:59:16,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 47c3e694 >2013-12-09 13:59:16,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b6ac04a >2013-12-09 13:59:16,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b6ac04a >2013-12-09 13:59:21,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67da65ee >2013-12-09 13:59:21,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 67da65ee >2013-12-09 13:59:21,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 105cda4c >2013-12-09 13:59:22,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 105cda4c >2013-12-09 13:59:27,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e5b80b5 >2013-12-09 13:59:27,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6e5b80b5 >2013-12-09 13:59:27,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1da3050c >2013-12-09 13:59:27,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1da3050c >2013-12-09 13:59:32,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e816986 >2013-12-09 13:59:33,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2e816986 >2013-12-09 13:59:33,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11e2bcc8 >2013-12-09 13:59:33,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11e2bcc8 >2013-12-09 13:59:38,750 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-86) Attempting to update VMs/Templates Ovf. >2013-12-09 13:59:38,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f52c25f >2013-12-09 13:59:39,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1f52c25f >2013-12-09 13:59:39,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b60db29 >2013-12-09 13:59:39,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b60db29 >2013-12-09 13:59:44,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73e9a1b >2013-12-09 13:59:44,639 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-4) Start refreshing all users data >2013-12-09 13:59:45,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 73e9a1b >2013-12-09 13:59:45,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: df23b17 >2013-12-09 13:59:45,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: df23b17 >2013-12-09 13:59:50,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f28eb5b >2013-12-09 13:59:50,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6f28eb5b >2013-12-09 13:59:50,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 567b56fd >2013-12-09 13:59:51,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 567b56fd >2013-12-09 13:59:53,677 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-45) No up server in cluster >2013-12-09 13:59:53,677 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-45) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 13:59:53,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23bd0f53 >2013-12-09 13:59:53,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterTasksListVDSCommand, return: [], log id: 23bd0f53 >2013-12-09 13:59:56,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71bfa1e4 >2013-12-09 13:59:56,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 71bfa1e4 >2013-12-09 13:59:56,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b5f77f7 >2013-12-09 13:59:56,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b5f77f7 >2013-12-09 14:00:01,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5af053f2 >2013-12-09 14:00:02,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5af053f2 >2013-12-09 14:00:02,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35a0fccf >2013-12-09 14:00:02,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35a0fccf >2013-12-09 14:00:07,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2443d834 >2013-12-09 14:00:08,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2443d834 >2013-12-09 14:00:08,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67079e88 >2013-12-09 14:00:08,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67079e88 >2013-12-09 14:00:13,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76bf72c7 >2013-12-09 14:00:13,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 76bf72c7 >2013-12-09 14:00:13,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2cdac7d9 >2013-12-09 14:00:14,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2cdac7d9 >2013-12-09 14:00:19,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a59eb87 >2013-12-09 14:00:19,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7a59eb87 >2013-12-09 14:00:19,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a9253e5 >2013-12-09 14:00:19,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a9253e5 >2013-12-09 14:00:24,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 651e9b3a >2013-12-09 14:00:25,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 651e9b3a >2013-12-09 14:00:25,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37d792d3 >2013-12-09 14:00:25,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37d792d3 >2013-12-09 14:00:30,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c1c1392 >2013-12-09 14:00:31,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c1c1392 >2013-12-09 14:00:31,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36bcba4 >2013-12-09 14:00:31,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36bcba4 >2013-12-09 14:00:36,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1fc54a85 >2013-12-09 14:00:37,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1fc54a85 >2013-12-09 14:00:37,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f0f7296 >2013-12-09 14:00:37,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f0f7296 >2013-12-09 14:00:42,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59bb136d >2013-12-09 14:00:42,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 59bb136d >2013-12-09 14:00:42,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a45728d >2013-12-09 14:00:43,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a45728d >2013-12-09 14:00:48,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a7bb23 >2013-12-09 14:00:48,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4a7bb23 >2013-12-09 14:00:48,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3125bc91 >2013-12-09 14:00:48,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3125bc91 >2013-12-09 14:00:53,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 460ed200 >2013-12-09 14:00:53,957 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-8) No up server in cluster >2013-12-09 14:00:53,957 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-8) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:00:53,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f160ed3 >2013-12-09 14:00:54,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5f160ed3 >2013-12-09 14:00:54,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 460ed200 >2013-12-09 14:00:54,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6342fc11 >2013-12-09 14:00:54,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6342fc11 >2013-12-09 14:00:59,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30f29ffc >2013-12-09 14:01:00,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 30f29ffc >2013-12-09 14:01:00,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74a65120 >2013-12-09 14:01:00,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74a65120 >2013-12-09 14:01:05,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 434ffff >2013-12-09 14:01:05,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 434ffff >2013-12-09 14:01:05,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 243ba5be >2013-12-09 14:01:06,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 243ba5be >2013-12-09 14:01:11,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d8049dc >2013-12-09 14:01:11,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: d8049dc >2013-12-09 14:01:11,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 324c38a9 >2013-12-09 14:01:11,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 324c38a9 >2013-12-09 14:01:16,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1effeb90 >2013-12-09 14:01:17,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1effeb90 >2013-12-09 14:01:17,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f976c42 >2013-12-09 14:01:17,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f976c42 >2013-12-09 14:01:22,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a68710f >2013-12-09 14:01:23,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a68710f >2013-12-09 14:01:23,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12792d53 >2013-12-09 14:01:23,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12792d53 >2013-12-09 14:01:28,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36cf9f9e >2013-12-09 14:01:29,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 36cf9f9e >2013-12-09 14:01:29,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2164bcc7 >2013-12-09 14:01:29,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2164bcc7 >2013-12-09 14:01:34,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6adc6325 >2013-12-09 14:01:34,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6adc6325 >2013-12-09 14:01:34,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 306c3844 >2013-12-09 14:01:35,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 306c3844 >2013-12-09 14:01:40,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2482be8f >2013-12-09 14:01:40,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2482be8f >2013-12-09 14:01:40,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f2f528d >2013-12-09 14:01:40,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f2f528d >2013-12-09 14:01:45,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a3da439 >2013-12-09 14:01:46,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a3da439 >2013-12-09 14:01:46,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 22f839d5 >2013-12-09 14:01:46,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22f839d5 >2013-12-09 14:01:51,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 539e4e4e >2013-12-09 14:01:52,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 539e4e4e >2013-12-09 14:01:52,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5fe634a3 >2013-12-09 14:01:52,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fe634a3 >2013-12-09 14:01:54,219 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2013-12-09 14:01:54,219 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:01:54,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 107adddd >2013-12-09 14:01:54,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterTasksListVDSCommand, return: [], log id: 107adddd >2013-12-09 14:01:57,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a392986 >2013-12-09 14:01:57,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2a392986 >2013-12-09 14:01:57,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b0ace9c >2013-12-09 14:01:58,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b0ace9c >2013-12-09 14:02:03,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3643c670 >2013-12-09 14:02:03,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3643c670 >2013-12-09 14:02:03,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29135ca4 >2013-12-09 14:02:03,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29135ca4 >2013-12-09 14:02:08,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6dec27b5 >2013-12-09 14:02:09,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6dec27b5 >2013-12-09 14:02:09,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a592ca0 >2013-12-09 14:02:09,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a592ca0 >2013-12-09 14:02:14,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51ea7933 >2013-12-09 14:02:15,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 51ea7933 >2013-12-09 14:02:15,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73a83430 >2013-12-09 14:02:15,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73a83430 >2013-12-09 14:02:20,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17c5fbde >2013-12-09 14:02:20,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 17c5fbde >2013-12-09 14:02:20,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 60ecc065 >2013-12-09 14:02:21,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60ecc065 >2013-12-09 14:02:26,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56e070f1 >2013-12-09 14:02:26,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 56e070f1 >2013-12-09 14:02:26,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55ddb7f9 >2013-12-09 14:02:27,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55ddb7f9 >2013-12-09 14:02:32,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34d21d0d >2013-12-09 14:02:32,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 34d21d0d >2013-12-09 14:02:32,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 459f6e7 >2013-12-09 14:02:32,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 459f6e7 >2013-12-09 14:02:37,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77b827d8 >2013-12-09 14:02:38,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 77b827d8 >2013-12-09 14:02:38,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4149f8fc >2013-12-09 14:02:38,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4149f8fc >2013-12-09 14:02:43,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 613b7846 >2013-12-09 14:02:44,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 613b7846 >2013-12-09 14:02:44,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e7e2656 >2013-12-09 14:02:44,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e7e2656 >2013-12-09 14:02:49,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c675636 >2013-12-09 14:02:49,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c675636 >2013-12-09 14:02:49,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 557b3ed2 >2013-12-09 14:02:50,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 557b3ed2 >2013-12-09 14:02:54,508 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-52) No up server in cluster >2013-12-09 14:02:54,508 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-52) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:02:54,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e9ed9bb >2013-12-09 14:02:54,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2e9ed9bb >2013-12-09 14:02:55,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1feef9b3 >2013-12-09 14:02:55,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1feef9b3 >2013-12-09 14:02:55,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e634f6e >2013-12-09 14:02:56,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e634f6e >2013-12-09 14:03:01,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b0b24fc >2013-12-09 14:03:01,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b0b24fc >2013-12-09 14:03:01,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62437645 >2013-12-09 14:03:01,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62437645 >2013-12-09 14:03:06,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e58d98b >2013-12-09 14:03:07,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e58d98b >2013-12-09 14:03:07,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 526baf81 >2013-12-09 14:03:07,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 526baf81 >2013-12-09 14:03:12,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10e5fb0a >2013-12-09 14:03:13,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 10e5fb0a >2013-12-09 14:03:13,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7127a7bf >2013-12-09 14:03:13,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7127a7bf >2013-12-09 14:03:18,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 416aecf9 >2013-12-09 14:03:19,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 416aecf9 >2013-12-09 14:03:19,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24866667 >2013-12-09 14:03:19,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24866667 >2013-12-09 14:03:24,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 363d027d >2013-12-09 14:03:24,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 363d027d >2013-12-09 14:03:24,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a29ebe7 >2013-12-09 14:03:25,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a29ebe7 >2013-12-09 14:03:30,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 541b5692 >2013-12-09 14:03:30,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 541b5692 >2013-12-09 14:03:30,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 743cc2b1 >2013-12-09 14:03:30,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 743cc2b1 >2013-12-09 14:03:35,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2dbf1a37 >2013-12-09 14:03:36,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2dbf1a37 >2013-12-09 14:03:36,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45e2074d >2013-12-09 14:03:36,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45e2074d >2013-12-09 14:03:41,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a823314 >2013-12-09 14:03:42,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2a823314 >2013-12-09 14:03:42,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 606211fe >2013-12-09 14:03:42,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 606211fe >2013-12-09 14:03:47,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 379bf77c >2013-12-09 14:03:47,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 379bf77c >2013-12-09 14:03:47,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d31a215 >2013-12-09 14:03:48,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d31a215 >2013-12-09 14:03:53,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60c3c775 >2013-12-09 14:03:53,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 60c3c775 >2013-12-09 14:03:53,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e66d3b8 >2013-12-09 14:03:53,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e66d3b8 >2013-12-09 14:03:54,798 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-7) No up server in cluster >2013-12-09 14:03:54,798 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-7) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:03:54,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40ed7793 >2013-12-09 14:03:55,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterTasksListVDSCommand, return: [], log id: 40ed7793 >2013-12-09 14:03:58,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14d50111 >2013-12-09 14:03:59,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 14d50111 >2013-12-09 14:03:59,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41724eb7 >2013-12-09 14:03:59,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41724eb7 >2013-12-09 14:04:04,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37a34f4a >2013-12-09 14:04:05,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 37a34f4a >2013-12-09 14:04:05,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59ad360 >2013-12-09 14:04:05,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59ad360 >2013-12-09 14:04:10,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7682ed4b >2013-12-09 14:04:11,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7682ed4b >2013-12-09 14:04:11,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c23fd7c >2013-12-09 14:04:11,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c23fd7c >2013-12-09 14:04:16,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 143884da >2013-12-09 14:04:16,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 143884da >2013-12-09 14:04:16,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32b30deb >2013-12-09 14:04:17,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32b30deb >2013-12-09 14:04:22,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c403f08 >2013-12-09 14:04:22,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2c403f08 >2013-12-09 14:04:22,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12cb83cf >2013-12-09 14:04:22,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12cb83cf >2013-12-09 14:04:27,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b5d456a >2013-12-09 14:04:28,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b5d456a >2013-12-09 14:04:28,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 458850ea >2013-12-09 14:04:28,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 458850ea >2013-12-09 14:04:33,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fba63c9 >2013-12-09 14:04:34,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2fba63c9 >2013-12-09 14:04:34,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4cff98a4 >2013-12-09 14:04:34,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4cff98a4 >2013-12-09 14:04:39,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c73af96 >2013-12-09 14:04:40,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c73af96 >2013-12-09 14:04:40,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 900ad3a >2013-12-09 14:04:40,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 900ad3a >2013-12-09 14:04:45,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8ef6e41 >2013-12-09 14:04:45,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 8ef6e41 >2013-12-09 14:04:45,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c7c1e53 >2013-12-09 14:04:46,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c7c1e53 >2013-12-09 14:04:51,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3732d985 >2013-12-09 14:04:51,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3732d985 >2013-12-09 14:04:51,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 457d823c >2013-12-09 14:04:51,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 457d823c >2013-12-09 14:04:55,070 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-90) No up server in cluster >2013-12-09 14:04:55,071 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-90) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:04:55,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46307e6e >2013-12-09 14:04:55,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterTasksListVDSCommand, return: [], log id: 46307e6e >2013-12-09 14:04:56,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a664670 >2013-12-09 14:04:57,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a664670 >2013-12-09 14:04:57,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 731210c5 >2013-12-09 14:04:57,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 731210c5 >2013-12-09 14:05:02,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50800e66 >2013-12-09 14:05:03,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 50800e66 >2013-12-09 14:05:03,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 255420d8 >2013-12-09 14:05:03,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 255420d8 >2013-12-09 14:05:08,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e264634 >2013-12-09 14:05:08,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e264634 >2013-12-09 14:05:08,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36bc1aa7 >2013-12-09 14:05:09,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36bc1aa7 >2013-12-09 14:05:14,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 181bd48f >2013-12-09 14:05:14,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 181bd48f >2013-12-09 14:05:14,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: deb62a2 >2013-12-09 14:05:14,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: deb62a2 >2013-12-09 14:05:19,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c76b41b >2013-12-09 14:05:20,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c76b41b >2013-12-09 14:05:20,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4cc448fa >2013-12-09 14:05:20,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4cc448fa >2013-12-09 14:05:25,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56aaa9c8 >2013-12-09 14:05:26,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 56aaa9c8 >2013-12-09 14:05:26,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 491de893 >2013-12-09 14:05:26,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 491de893 >2013-12-09 14:05:31,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f09d622 >2013-12-09 14:05:31,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7f09d622 >2013-12-09 14:05:31,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4fd3de2d >2013-12-09 14:05:32,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fd3de2d >2013-12-09 14:05:37,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 129586ba >2013-12-09 14:05:37,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 129586ba >2013-12-09 14:05:37,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 439b4167 >2013-12-09 14:05:38,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 439b4167 >2013-12-09 14:05:43,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a56b22 >2013-12-09 14:05:43,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a56b22 >2013-12-09 14:05:43,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d7cc6f5 >2013-12-09 14:05:43,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d7cc6f5 >2013-12-09 14:05:48,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 669901f1 >2013-12-09 14:05:49,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 669901f1 >2013-12-09 14:05:49,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 655710c8 >2013-12-09 14:05:49,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 655710c8 >2013-12-09 14:05:54,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f53a0ab >2013-12-09 14:05:55,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f53a0ab >2013-12-09 14:05:55,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66e415 >2013-12-09 14:05:55,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66e415 >2013-12-09 14:05:55,342 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-99) No up server in cluster >2013-12-09 14:05:55,342 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-99) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:05:55,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b91452b >2013-12-09 14:05:55,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5b91452b >2013-12-09 14:06:00,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3fbb4175 >2013-12-09 14:06:00,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3fbb4175 >2013-12-09 14:06:00,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b1a786d >2013-12-09 14:06:01,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b1a786d >2013-12-09 14:06:06,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79a77aa4 >2013-12-09 14:06:06,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 79a77aa4 >2013-12-09 14:06:06,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74100a04 >2013-12-09 14:06:06,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74100a04 >2013-12-09 14:06:11,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 467b5b1f >2013-12-09 14:06:12,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 467b5b1f >2013-12-09 14:06:12,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 264ee10b >2013-12-09 14:06:12,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 264ee10b >2013-12-09 14:06:17,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59f8f79f >2013-12-09 14:06:18,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 59f8f79f >2013-12-09 14:06:18,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6eb3496b >2013-12-09 14:06:18,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6eb3496b >2013-12-09 14:06:23,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32c0b592 >2013-12-09 14:06:23,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 32c0b592 >2013-12-09 14:06:23,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f70799f >2013-12-09 14:06:24,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f70799f >2013-12-09 14:06:29,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2da5e991 >2013-12-09 14:06:29,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2da5e991 >2013-12-09 14:06:29,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51c41de >2013-12-09 14:06:29,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51c41de >2013-12-09 14:06:34,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 272d9228 >2013-12-09 14:06:35,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 272d9228 >2013-12-09 14:06:35,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bb07a08 >2013-12-09 14:06:35,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4bb07a08 >2013-12-09 14:06:40,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 250174a8 >2013-12-09 14:06:41,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 250174a8 >2013-12-09 14:06:41,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d797c18 >2013-12-09 14:06:41,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d797c18 >2013-12-09 14:06:46,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4640ce7c >2013-12-09 14:06:47,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4640ce7c >2013-12-09 14:06:47,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ad8769a >2013-12-09 14:06:47,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ad8769a >2013-12-09 14:06:52,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11efee80 >2013-12-09 14:06:52,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 11efee80 >2013-12-09 14:06:52,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fa8c83e >2013-12-09 14:06:53,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fa8c83e >2013-12-09 14:06:55,623 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-19) No up server in cluster >2013-12-09 14:06:55,623 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-19) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:06:55,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 363a56d >2013-12-09 14:06:55,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterTasksListVDSCommand, return: [], log id: 363a56d >2013-12-09 14:06:58,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33a1ee4b >2013-12-09 14:06:58,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 33a1ee4b >2013-12-09 14:06:58,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44bc8d4e >2013-12-09 14:06:58,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44bc8d4e >2013-12-09 14:07:03,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 24882fb8 >2013-12-09 14:07:04,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 24882fb8 >2013-12-09 14:07:04,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59baa66c >2013-12-09 14:07:04,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59baa66c >2013-12-09 14:07:09,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f30a282 >2013-12-09 14:07:10,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3f30a282 >2013-12-09 14:07:10,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 883189f >2013-12-09 14:07:10,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 883189f >2013-12-09 14:07:15,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14ea8e4b >2013-12-09 14:07:15,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 14ea8e4b >2013-12-09 14:07:15,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9a5bd1e >2013-12-09 14:07:16,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9a5bd1e >2013-12-09 14:07:21,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d88064e >2013-12-09 14:07:21,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2d88064e >2013-12-09 14:07:21,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5021b89a >2013-12-09 14:07:22,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5021b89a >2013-12-09 14:07:27,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46962671 >2013-12-09 14:07:27,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 46962671 >2013-12-09 14:07:27,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56c7b36b >2013-12-09 14:07:27,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56c7b36b >2013-12-09 14:07:32,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41d87eb1 >2013-12-09 14:07:33,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 41d87eb1 >2013-12-09 14:07:33,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e08849e >2013-12-09 14:07:33,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e08849e >2013-12-09 14:07:38,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a1077e7 >2013-12-09 14:07:39,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a1077e7 >2013-12-09 14:07:39,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3cf2e49e >2013-12-09 14:07:39,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3cf2e49e >2013-12-09 14:07:44,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e7828f7 >2013-12-09 14:07:44,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e7828f7 >2013-12-09 14:07:44,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3250f182 >2013-12-09 14:07:45,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3250f182 >2013-12-09 14:07:50,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a2a9f03 >2013-12-09 14:07:50,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3a2a9f03 >2013-12-09 14:07:50,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 488664dd >2013-12-09 14:07:50,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 488664dd >2013-12-09 14:07:55,907 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-47) No up server in cluster >2013-12-09 14:07:55,907 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-47) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:07:55,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f6f2fea >2013-12-09 14:07:55,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23f4f83d >2013-12-09 14:07:56,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterTasksListVDSCommand, return: [], log id: 23f4f83d >2013-12-09 14:07:56,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7f6f2fea >2013-12-09 14:07:56,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71760e20 >2013-12-09 14:07:56,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71760e20 >2013-12-09 14:08:01,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38948fd6 >2013-12-09 14:08:02,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 38948fd6 >2013-12-09 14:08:02,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f1de048 >2013-12-09 14:08:02,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f1de048 >2013-12-09 14:08:07,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8f9d035 >2013-12-09 14:08:07,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 8f9d035 >2013-12-09 14:08:07,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27bc33e2 >2013-12-09 14:08:08,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27bc33e2 >2013-12-09 14:08:13,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 117ac6e0 >2013-12-09 14:08:13,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 117ac6e0 >2013-12-09 14:08:13,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 44dfdc29 >2013-12-09 14:08:14,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44dfdc29 >2013-12-09 14:08:19,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a1228cd >2013-12-09 14:08:19,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4a1228cd >2013-12-09 14:08:19,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c34ed15 >2013-12-09 14:08:19,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c34ed15 >2013-12-09 14:08:24,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3cac81d2 >2013-12-09 14:08:25,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3cac81d2 >2013-12-09 14:08:25,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16cee29 >2013-12-09 14:08:25,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16cee29 >2013-12-09 14:08:30,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2483ef1b >2013-12-09 14:08:31,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2483ef1b >2013-12-09 14:08:31,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67d8c9ae >2013-12-09 14:08:31,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67d8c9ae >2013-12-09 14:08:36,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f50f1ee >2013-12-09 14:08:36,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: f50f1ee >2013-12-09 14:08:36,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: be95dbb >2013-12-09 14:08:37,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: be95dbb >2013-12-09 14:08:42,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d7a78d >2013-12-09 14:08:42,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d7a78d >2013-12-09 14:08:42,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b67039d >2013-12-09 14:08:42,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b67039d >2013-12-09 14:08:47,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2443665b >2013-12-09 14:08:48,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2443665b >2013-12-09 14:08:48,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7710561a >2013-12-09 14:08:48,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7710561a >2013-12-09 14:08:53,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 85c60c6 >2013-12-09 14:08:54,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 85c60c6 >2013-12-09 14:08:54,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f4cc2a >2013-12-09 14:08:54,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f4cc2a >2013-12-09 14:08:56,184 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) No up server in cluster >2013-12-09 14:08:56,184 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:08:56,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1304d1fd >2013-12-09 14:08:56,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1304d1fd >2013-12-09 14:08:59,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6016bb0c >2013-12-09 14:08:59,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6016bb0c >2013-12-09 14:08:59,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 342b4dc >2013-12-09 14:09:00,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 342b4dc >2013-12-09 14:09:05,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ccee3cf >2013-12-09 14:09:05,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6ccee3cf >2013-12-09 14:09:05,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7476ed3 >2013-12-09 14:09:06,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7476ed3 >2013-12-09 14:09:11,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7cb21778 >2013-12-09 14:09:11,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7cb21778 >2013-12-09 14:09:11,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f5c4949 >2013-12-09 14:09:11,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f5c4949 >2013-12-09 14:09:16,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5158b0d8 >2013-12-09 14:09:17,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5158b0d8 >2013-12-09 14:09:17,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6da64ba5 >2013-12-09 14:09:17,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6da64ba5 >2013-12-09 14:09:22,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ce95f78 >2013-12-09 14:09:23,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ce95f78 >2013-12-09 14:09:23,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5033fa30 >2013-12-09 14:09:23,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5033fa30 >2013-12-09 14:09:28,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5821a91e >2013-12-09 14:09:28,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5821a91e >2013-12-09 14:09:28,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38b405b6 >2013-12-09 14:09:29,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38b405b6 >2013-12-09 14:09:34,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 655371b1 >2013-12-09 14:09:34,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 655371b1 >2013-12-09 14:09:34,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42f96041 >2013-12-09 14:09:34,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42f96041 >2013-12-09 14:09:39,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c1cecaf >2013-12-09 14:09:40,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: c1cecaf >2013-12-09 14:09:40,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2419807a >2013-12-09 14:09:40,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2419807a >2013-12-09 14:09:45,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f2a5e1a >2013-12-09 14:09:46,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1f2a5e1a >2013-12-09 14:09:46,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50008a3 >2013-12-09 14:09:46,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50008a3 >2013-12-09 14:09:51,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 326820bf >2013-12-09 14:09:51,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 326820bf >2013-12-09 14:09:51,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c4e3b00 >2013-12-09 14:09:52,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c4e3b00 >2013-12-09 14:09:56,470 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-6) No up server in cluster >2013-12-09 14:09:56,470 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-6) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:09:56,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f47e010 >2013-12-09 14:09:56,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterTasksListVDSCommand, return: [], log id: f47e010 >2013-12-09 14:09:57,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3fad2a05 >2013-12-09 14:09:57,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3fad2a05 >2013-12-09 14:09:57,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55764c93 >2013-12-09 14:09:58,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55764c93 >2013-12-09 14:10:03,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2952984c >2013-12-09 14:10:03,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2952984c >2013-12-09 14:10:03,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4388bba9 >2013-12-09 14:10:03,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4388bba9 >2013-12-09 14:10:08,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 326d60f3 >2013-12-09 14:10:09,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 326d60f3 >2013-12-09 14:10:09,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2038430f >2013-12-09 14:10:09,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2038430f >2013-12-09 14:10:14,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fafdf89 >2013-12-09 14:10:15,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7fafdf89 >2013-12-09 14:10:15,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1817fa8 >2013-12-09 14:10:15,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1817fa8 >2013-12-09 14:10:20,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58b06cd9 >2013-12-09 14:10:20,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 58b06cd9 >2013-12-09 14:10:20,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6dd09661 >2013-12-09 14:10:21,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6dd09661 >2013-12-09 14:10:26,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fe42c30 >2013-12-09 14:10:26,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7fe42c30 >2013-12-09 14:10:26,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34412025 >2013-12-09 14:10:26,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34412025 >2013-12-09 14:10:31,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37d76313 >2013-12-09 14:10:32,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 37d76313 >2013-12-09 14:10:32,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a4695a6 >2013-12-09 14:10:32,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a4695a6 >2013-12-09 14:10:37,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 781dd02 >2013-12-09 14:10:38,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 781dd02 >2013-12-09 14:10:38,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53cfdbb5 >2013-12-09 14:10:38,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53cfdbb5 >2013-12-09 14:10:43,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b16537e >2013-12-09 14:10:43,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b16537e >2013-12-09 14:10:43,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6030c93 >2013-12-09 14:10:44,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6030c93 >2013-12-09 14:10:49,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 169576f3 >2013-12-09 14:10:49,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 169576f3 >2013-12-09 14:10:49,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e9877ef >2013-12-09 14:10:50,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e9877ef >2013-12-09 14:10:55,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a891228 >2013-12-09 14:10:55,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3a891228 >2013-12-09 14:10:55,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fd98680 >2013-12-09 14:10:55,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2fd98680 >2013-12-09 14:10:56,740 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-46) No up server in cluster >2013-12-09 14:10:56,740 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-46) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:10:56,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 775a656c >2013-12-09 14:10:56,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterTasksListVDSCommand, return: [], log id: 775a656c >2013-12-09 14:11:00,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 639abf61 >2013-12-09 14:11:01,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 639abf61 >2013-12-09 14:11:01,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ec693b7 >2013-12-09 14:11:01,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ec693b7 >2013-12-09 14:11:06,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: bd8ea2 >2013-12-09 14:11:07,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: bd8ea2 >2013-12-09 14:11:07,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2128e88b >2013-12-09 14:11:07,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2128e88b >2013-12-09 14:11:12,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52ecf1bc >2013-12-09 14:11:12,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 52ecf1bc >2013-12-09 14:11:12,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32fe30a8 >2013-12-09 14:11:13,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32fe30a8 >2013-12-09 14:11:18,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2396c1aa >2013-12-09 14:11:18,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2396c1aa >2013-12-09 14:11:18,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 478aaa88 >2013-12-09 14:11:18,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 478aaa88 >2013-12-09 14:11:23,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46d2ed6b >2013-12-09 14:11:24,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 46d2ed6b >2013-12-09 14:11:24,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30e5ee8a >2013-12-09 14:11:24,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30e5ee8a >2013-12-09 14:11:29,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64704c40 >2013-12-09 14:11:30,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 64704c40 >2013-12-09 14:11:30,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6dd90965 >2013-12-09 14:11:30,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6dd90965 >2013-12-09 14:11:35,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a001f23 >2013-12-09 14:11:36,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2a001f23 >2013-12-09 14:11:36,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16e834d >2013-12-09 14:11:36,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16e834d >2013-12-09 14:11:41,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4eff0bec >2013-12-09 14:11:41,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4eff0bec >2013-12-09 14:11:41,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5fec9c80 >2013-12-09 14:11:42,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fec9c80 >2013-12-09 14:11:47,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ebc3d29 >2013-12-09 14:11:47,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2ebc3d29 >2013-12-09 14:11:47,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34ef3b0b >2013-12-09 14:11:47,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34ef3b0b >2013-12-09 14:11:52,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 663300a2 >2013-12-09 14:11:53,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 663300a2 >2013-12-09 14:11:53,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ea81819 >2013-12-09 14:11:53,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ea81819 >2013-12-09 14:11:57,005 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-11) No up server in cluster >2013-12-09 14:11:57,005 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-11) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:11:57,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b50fcfa >2013-12-09 14:11:57,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7b50fcfa >2013-12-09 14:11:58,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5995e7e9 >2013-12-09 14:11:59,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5995e7e9 >2013-12-09 14:11:59,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7db68dc3 >2013-12-09 14:11:59,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7db68dc3 >2013-12-09 14:12:04,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13c484cb >2013-12-09 14:12:04,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 13c484cb >2013-12-09 14:12:04,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b524f8 >2013-12-09 14:12:05,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b524f8 >2013-12-09 14:12:10,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6bf62c3b >2013-12-09 14:12:10,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6bf62c3b >2013-12-09 14:12:10,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32e1b366 >2013-12-09 14:12:10,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32e1b366 >2013-12-09 14:12:16,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e763746 >2013-12-09 14:12:16,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1e763746 >2013-12-09 14:12:16,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11bca7ee >2013-12-09 14:12:16,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11bca7ee >2013-12-09 14:12:21,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8008c4a >2013-12-09 14:12:22,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 8008c4a >2013-12-09 14:12:22,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 373e1da7 >2013-12-09 14:12:22,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 373e1da7 >2013-12-09 14:12:27,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52a27eef >2013-12-09 14:12:28,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 52a27eef >2013-12-09 14:12:28,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c34dedf >2013-12-09 14:12:28,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c34dedf >2013-12-09 14:12:33,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54a85daa >2013-12-09 14:12:33,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 54a85daa >2013-12-09 14:12:33,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ea13d83 >2013-12-09 14:12:34,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ea13d83 >2013-12-09 14:12:39,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a93c536 >2013-12-09 14:12:39,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: a93c536 >2013-12-09 14:12:39,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 278fa007 >2013-12-09 14:12:39,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 278fa007 >2013-12-09 14:12:44,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75646e44 >2013-12-09 14:12:45,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 75646e44 >2013-12-09 14:12:45,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e380597 >2013-12-09 14:12:45,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e380597 >2013-12-09 14:12:50,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b2e1acc >2013-12-09 14:12:51,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b2e1acc >2013-12-09 14:12:51,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6534f721 >2013-12-09 14:12:51,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6534f721 >2013-12-09 14:12:56,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 459ba61c >2013-12-09 14:12:56,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 459ba61c >2013-12-09 14:12:56,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d694c9e >2013-12-09 14:12:57,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d694c9e >2013-12-09 14:12:57,282 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-97) No up server in cluster >2013-12-09 14:12:57,282 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-97) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:12:57,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ec03944 >2013-12-09 14:12:57,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1ec03944 >2013-12-09 14:13:02,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7710d2b9 >2013-12-09 14:13:02,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7710d2b9 >2013-12-09 14:13:02,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5629c127 >2013-12-09 14:13:02,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5629c127 >2013-12-09 14:13:08,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e6c73de >2013-12-09 14:13:08,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e6c73de >2013-12-09 14:13:08,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ce8239f >2013-12-09 14:13:08,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ce8239f >2013-12-09 14:13:13,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1214134f >2013-12-09 14:13:14,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1214134f >2013-12-09 14:13:14,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68d8df0a >2013-12-09 14:13:14,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68d8df0a >2013-12-09 14:13:19,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2097f3ec >2013-12-09 14:13:20,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2097f3ec >2013-12-09 14:13:20,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 432b168a >2013-12-09 14:13:20,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 432b168a >2013-12-09 14:13:25,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 470c0dfc >2013-12-09 14:13:25,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 470c0dfc >2013-12-09 14:13:25,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ab063a1 >2013-12-09 14:13:26,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ab063a1 >2013-12-09 14:13:31,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6673446 >2013-12-09 14:13:31,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6673446 >2013-12-09 14:13:31,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16aff819 >2013-12-09 14:13:31,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16aff819 >2013-12-09 14:13:36,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c90ea4f >2013-12-09 14:13:37,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c90ea4f >2013-12-09 14:13:37,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 422e5371 >2013-12-09 14:13:37,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 422e5371 >2013-12-09 14:13:42,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b155c54 >2013-12-09 14:13:43,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: b155c54 >2013-12-09 14:13:43,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f675468 >2013-12-09 14:13:43,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f675468 >2013-12-09 14:13:48,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b8cc8b5 >2013-12-09 14:13:48,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b8cc8b5 >2013-12-09 14:13:48,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a0ce3f4 >2013-12-09 14:13:49,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a0ce3f4 >2013-12-09 14:13:54,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 375b3090 >2013-12-09 14:13:54,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 375b3090 >2013-12-09 14:13:54,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 532d9128 >2013-12-09 14:13:55,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 532d9128 >2013-12-09 14:13:57,555 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-82) No up server in cluster >2013-12-09 14:13:57,555 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-82) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:13:57,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5586f793 >2013-12-09 14:13:57,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5586f793 >2013-12-09 14:14:00,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b0eecc1 >2013-12-09 14:14:00,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b0eecc1 >2013-12-09 14:14:00,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35e548e1 >2013-12-09 14:14:01,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35e548e1 >2013-12-09 14:14:06,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7bec7f14 >2013-12-09 14:14:06,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7bec7f14 >2013-12-09 14:14:06,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20c33256 >2013-12-09 14:14:06,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20c33256 >2013-12-09 14:14:11,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6653442e >2013-12-09 14:14:12,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6653442e >2013-12-09 14:14:12,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7611e0f1 >2013-12-09 14:14:12,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7611e0f1 >2013-12-09 14:14:17,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31a98412 >2013-12-09 14:14:18,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 31a98412 >2013-12-09 14:14:18,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e003d0f >2013-12-09 14:14:18,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e003d0f >2013-12-09 14:14:23,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2cdb143c >2013-12-09 14:14:23,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2cdb143c >2013-12-09 14:14:23,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e932d0f >2013-12-09 14:14:24,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e932d0f >2013-12-09 14:14:29,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66f2920d >2013-12-09 14:14:29,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 66f2920d >2013-12-09 14:14:29,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ccb8ff2 >2013-12-09 14:14:29,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ccb8ff2 >2013-12-09 14:14:34,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c0027b5 >2013-12-09 14:14:35,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c0027b5 >2013-12-09 14:14:35,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36a84d1c >2013-12-09 14:14:35,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36a84d1c >2013-12-09 14:14:40,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a8ccaf7 >2013-12-09 14:14:41,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2a8ccaf7 >2013-12-09 14:14:41,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62c41fef >2013-12-09 14:14:41,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62c41fef >2013-12-09 14:14:46,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2fb63213 >2013-12-09 14:14:46,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2fb63213 >2013-12-09 14:14:46,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b4d03fc >2013-12-09 14:14:47,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b4d03fc >2013-12-09 14:14:52,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a91f6a7 >2013-12-09 14:14:52,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3a91f6a7 >2013-12-09 14:14:52,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 49f2987d >2013-12-09 14:14:53,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49f2987d >2013-12-09 14:14:57,845 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) No up server in cluster >2013-12-09 14:14:57,846 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:14:57,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63f4a24 >2013-12-09 14:14:58,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 521ea2b2 >2013-12-09 14:14:58,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterTasksListVDSCommand, return: [], log id: 63f4a24 >2013-12-09 14:14:58,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 521ea2b2 >2013-12-09 14:14:58,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2318923c >2013-12-09 14:14:58,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2318923c >2013-12-09 14:15:03,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b2b0b0e >2013-12-09 14:15:04,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b2b0b0e >2013-12-09 14:15:04,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 676fe016 >2013-12-09 14:15:04,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 676fe016 >2013-12-09 14:15:09,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b65effd >2013-12-09 14:15:10,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3b65effd >2013-12-09 14:15:10,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60204d1 >2013-12-09 14:15:10,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60204d1 >2013-12-09 14:15:15,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d21439 >2013-12-09 14:15:15,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d21439 >2013-12-09 14:15:15,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49b89d2b >2013-12-09 14:15:16,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49b89d2b >2013-12-09 14:15:21,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6566d72 >2013-12-09 14:15:21,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6566d72 >2013-12-09 14:15:21,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62a92bfc >2013-12-09 14:15:21,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62a92bfc >2013-12-09 14:15:26,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73b382f2 >2013-12-09 14:15:27,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 73b382f2 >2013-12-09 14:15:27,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16fec520 >2013-12-09 14:15:27,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16fec520 >2013-12-09 14:15:32,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d0c4dfd >2013-12-09 14:15:33,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d0c4dfd >2013-12-09 14:15:33,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 791a92e1 >2013-12-09 14:15:33,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 791a92e1 >2013-12-09 14:15:38,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6614e4c5 >2013-12-09 14:15:38,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6614e4c5 >2013-12-09 14:15:38,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 87a1e24 >2013-12-09 14:15:39,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 87a1e24 >2013-12-09 14:15:44,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 756273f5 >2013-12-09 14:15:44,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 756273f5 >2013-12-09 14:15:44,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7218a695 >2013-12-09 14:15:44,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7218a695 >2013-12-09 14:15:50,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1482c53c >2013-12-09 14:15:50,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1482c53c >2013-12-09 14:15:50,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f2b1974 >2013-12-09 14:15:50,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f2b1974 >2013-12-09 14:15:55,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 346ab0e8 >2013-12-09 14:15:56,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 346ab0e8 >2013-12-09 14:15:56,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7bfa6838 >2013-12-09 14:15:56,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7bfa6838 >2013-12-09 14:15:58,116 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-87) No up server in cluster >2013-12-09 14:15:58,116 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-87) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:15:58,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b076622 >2013-12-09 14:15:58,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1b076622 >2013-12-09 14:16:01,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e455fc8 >2013-12-09 14:16:02,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2e455fc8 >2013-12-09 14:16:02,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fbcb8a4 >2013-12-09 14:16:02,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fbcb8a4 >2013-12-09 14:16:07,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29e62cab >2013-12-09 14:16:07,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 29e62cab >2013-12-09 14:16:07,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43f487d0 >2013-12-09 14:16:08,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43f487d0 >2013-12-09 14:16:13,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28b7fcc9 >2013-12-09 14:16:13,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 28b7fcc9 >2013-12-09 14:16:13,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e52eaa5 >2013-12-09 14:16:13,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e52eaa5 >2013-12-09 14:16:18,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d5da49a >2013-12-09 14:16:19,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: d5da49a >2013-12-09 14:16:19,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10e319c7 >2013-12-09 14:16:19,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10e319c7 >2013-12-09 14:16:24,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6685539f >2013-12-09 14:16:25,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6685539f >2013-12-09 14:16:25,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4617f4d6 >2013-12-09 14:16:25,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4617f4d6 >2013-12-09 14:16:30,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f31f942 >2013-12-09 14:16:30,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7f31f942 >2013-12-09 14:16:30,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d1872e3 >2013-12-09 14:16:31,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d1872e3 >2013-12-09 14:16:36,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ad2e0d3 >2013-12-09 14:16:36,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7ad2e0d3 >2013-12-09 14:16:36,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4bea5acc >2013-12-09 14:16:37,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4bea5acc >2013-12-09 14:16:42,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54885f03 >2013-12-09 14:16:42,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 54885f03 >2013-12-09 14:16:42,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 599791a7 >2013-12-09 14:16:42,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 599791a7 >2013-12-09 14:16:47,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3186a272 >2013-12-09 14:16:48,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3186a272 >2013-12-09 14:16:48,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d5b457a >2013-12-09 14:16:48,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d5b457a >2013-12-09 14:16:53,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ddcbe65 >2013-12-09 14:16:54,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1ddcbe65 >2013-12-09 14:16:54,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c00cfc4 >2013-12-09 14:16:54,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c00cfc4 >2013-12-09 14:16:58,391 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-77) No up server in cluster >2013-12-09 14:16:58,392 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-77) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:16:58,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7446fe3d >2013-12-09 14:16:58,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7446fe3d >2013-12-09 14:16:59,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 178e49a7 >2013-12-09 14:16:59,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 178e49a7 >2013-12-09 14:16:59,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 535342af >2013-12-09 14:17:00,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 535342af >2013-12-09 14:17:05,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ccd1333 >2013-12-09 14:17:05,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ccd1333 >2013-12-09 14:17:05,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b9ea15f >2013-12-09 14:17:05,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b9ea15f >2013-12-09 14:17:10,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 521ff84d >2013-12-09 14:17:11,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 521ff84d >2013-12-09 14:17:11,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7227ebd9 >2013-12-09 14:17:11,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7227ebd9 >2013-12-09 14:17:16,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e57beb4 >2013-12-09 14:17:17,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2e57beb4 >2013-12-09 14:17:17,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5200216a >2013-12-09 14:17:17,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5200216a >2013-12-09 14:17:22,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f04a435 >2013-12-09 14:17:22,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: f04a435 >2013-12-09 14:17:22,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fd14a84 >2013-12-09 14:17:23,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2fd14a84 >2013-12-09 14:17:28,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7bf0819d >2013-12-09 14:17:28,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7bf0819d >2013-12-09 14:17:28,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c9d90a >2013-12-09 14:17:28,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c9d90a >2013-12-09 14:17:33,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c354b74 >2013-12-09 14:17:34,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c354b74 >2013-12-09 14:17:34,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ac0b4e2 >2013-12-09 14:17:34,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ac0b4e2 >2013-12-09 14:17:39,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e49f2d6 >2013-12-09 14:17:40,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: e49f2d6 >2013-12-09 14:17:40,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c7c715b >2013-12-09 14:17:40,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c7c715b >2013-12-09 14:17:45,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ee762d2 >2013-12-09 14:17:46,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2ee762d2 >2013-12-09 14:17:46,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51833913 >2013-12-09 14:17:46,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51833913 >2013-12-09 14:17:51,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 466bd898 >2013-12-09 14:17:51,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 466bd898 >2013-12-09 14:17:51,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 90505a1 >2013-12-09 14:17:52,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 90505a1 >2013-12-09 14:17:57,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7369854f >2013-12-09 14:17:57,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7369854f >2013-12-09 14:17:57,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60bd3bba >2013-12-09 14:17:57,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60bd3bba >2013-12-09 14:17:58,677 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-64) No up server in cluster >2013-12-09 14:17:58,677 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-64) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:17:58,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3180acb2 >2013-12-09 14:17:59,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3180acb2 >2013-12-09 14:18:02,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26cab2cc >2013-12-09 14:18:03,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 26cab2cc >2013-12-09 14:18:03,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16dfd2f8 >2013-12-09 14:18:03,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16dfd2f8 >2013-12-09 14:18:08,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 499897a7 >2013-12-09 14:18:09,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 499897a7 >2013-12-09 14:18:09,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 120a6434 >2013-12-09 14:18:09,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 120a6434 >2013-12-09 14:18:14,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9fa2ba6 >2013-12-09 14:18:14,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 9fa2ba6 >2013-12-09 14:18:14,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12991660 >2013-12-09 14:18:15,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12991660 >2013-12-09 14:18:20,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 625b9dab >2013-12-09 14:18:20,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 625b9dab >2013-12-09 14:18:20,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e804db4 >2013-12-09 14:18:20,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e804db4 >2013-12-09 14:18:25,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d0bf5dc >2013-12-09 14:18:26,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2d0bf5dc >2013-12-09 14:18:26,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 89a6a3f >2013-12-09 14:18:26,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 89a6a3f >2013-12-09 14:18:31,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7849f104 >2013-12-09 14:18:32,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7849f104 >2013-12-09 14:18:32,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9006f0e >2013-12-09 14:18:32,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9006f0e >2013-12-09 14:18:37,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a0fc225 >2013-12-09 14:18:38,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: a0fc225 >2013-12-09 14:18:38,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61e18426 >2013-12-09 14:18:38,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61e18426 >2013-12-09 14:18:43,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39a91339 >2013-12-09 14:18:43,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 39a91339 >2013-12-09 14:18:43,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 190be95 >2013-12-09 14:18:44,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 190be95 >2013-12-09 14:18:49,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 331e8a34 >2013-12-09 14:18:49,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 331e8a34 >2013-12-09 14:18:49,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f7046f9 >2013-12-09 14:18:49,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f7046f9 >2013-12-09 14:18:54,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 514f586b >2013-12-09 14:18:55,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 514f586b >2013-12-09 14:18:55,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5fcb38c7 >2013-12-09 14:18:55,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fcb38c7 >2013-12-09 14:18:59,119 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-69) No up server in cluster >2013-12-09 14:18:59,119 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-69) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:18:59,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4313b9a4 >2013-12-09 14:18:59,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4313b9a4 >2013-12-09 14:19:00,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b2ef263 >2013-12-09 14:19:01,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b2ef263 >2013-12-09 14:19:01,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9d88206 >2013-12-09 14:19:01,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9d88206 >2013-12-09 14:19:06,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d54f42c >2013-12-09 14:19:06,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2d54f42c >2013-12-09 14:19:06,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 204d85dd >2013-12-09 14:19:07,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 204d85dd >2013-12-09 14:19:12,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 773896c3 >2013-12-09 14:19:12,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 773896c3 >2013-12-09 14:19:12,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1374b5e2 >2013-12-09 14:19:12,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1374b5e2 >2013-12-09 14:19:17,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b906a14 >2013-12-09 14:19:18,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b906a14 >2013-12-09 14:19:18,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2494cdab >2013-12-09 14:19:18,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2494cdab >2013-12-09 14:19:23,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bc8f8d3 >2013-12-09 14:19:24,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2bc8f8d3 >2013-12-09 14:19:24,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 746f15c2 >2013-12-09 14:19:24,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 746f15c2 >2013-12-09 14:19:29,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5886d22b >2013-12-09 14:19:30,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5886d22b >2013-12-09 14:19:30,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f20aa0a >2013-12-09 14:19:30,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f20aa0a >2013-12-09 14:19:35,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7aec8fa3 >2013-12-09 14:19:35,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7aec8fa3 >2013-12-09 14:19:35,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67b730ca >2013-12-09 14:19:36,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67b730ca >2013-12-09 14:19:41,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53787330 >2013-12-09 14:19:41,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 53787330 >2013-12-09 14:19:41,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 477fadde >2013-12-09 14:19:41,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 477fadde >2013-12-09 14:19:46,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36a41b95 >2013-12-09 14:19:47,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 36a41b95 >2013-12-09 14:19:47,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5038317a >2013-12-09 14:19:47,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5038317a >2013-12-09 14:19:52,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45806827 >2013-12-09 14:19:53,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 45806827 >2013-12-09 14:19:53,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4325f6b >2013-12-09 14:19:53,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4325f6b >2013-12-09 14:19:58,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f4f81de >2013-12-09 14:19:58,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1f4f81de >2013-12-09 14:19:58,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a6d916e >2013-12-09 14:19:59,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a6d916e >2013-12-09 14:19:59,389 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-52) No up server in cluster >2013-12-09 14:19:59,389 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-52) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:19:59,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2431576f >2013-12-09 14:19:59,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2431576f >2013-12-09 14:20:04,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2bd8f1ae >2013-12-09 14:20:04,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2bd8f1ae >2013-12-09 14:20:04,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69e1d296 >2013-12-09 14:20:04,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69e1d296 >2013-12-09 14:20:09,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b3c61ef >2013-12-09 14:20:10,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4b3c61ef >2013-12-09 14:20:10,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6be87ba1 >2013-12-09 14:20:10,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6be87ba1 >2013-12-09 14:20:15,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16d5157b >2013-12-09 14:20:16,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 16d5157b >2013-12-09 14:20:16,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d20ddc0 >2013-12-09 14:20:16,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d20ddc0 >2013-12-09 14:20:21,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35f35dd5 >2013-12-09 14:20:21,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 35f35dd5 >2013-12-09 14:20:22,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 598befed >2013-12-09 14:20:22,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 598befed >2013-12-09 14:20:27,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b741903 >2013-12-09 14:20:27,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b741903 >2013-12-09 14:20:27,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1826feaf >2013-12-09 14:20:28,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1826feaf >2013-12-09 14:20:33,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26c90925 >2013-12-09 14:20:33,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 26c90925 >2013-12-09 14:20:33,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 190ed83 >2013-12-09 14:20:33,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 190ed83 >2013-12-09 14:20:38,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5cc24230 >2013-12-09 14:20:39,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5cc24230 >2013-12-09 14:20:39,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b67e3a5 >2013-12-09 14:20:39,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b67e3a5 >2013-12-09 14:20:44,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12259308 >2013-12-09 14:20:45,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 12259308 >2013-12-09 14:20:45,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5af88da >2013-12-09 14:20:45,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5af88da >2013-12-09 14:20:50,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2189b0f2 >2013-12-09 14:20:50,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2189b0f2 >2013-12-09 14:20:50,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 358efcd6 >2013-12-09 14:20:51,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 358efcd6 >2013-12-09 14:20:56,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b510c10 >2013-12-09 14:20:56,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: b510c10 >2013-12-09 14:20:56,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4655b338 >2013-12-09 14:20:56,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4655b338 >2013-12-09 14:20:59,674 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-30) No up server in cluster >2013-12-09 14:20:59,674 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-30) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:20:59,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27e313e5 >2013-12-09 14:20:59,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterTasksListVDSCommand, return: [], log id: 27e313e5 >2013-12-09 14:21:01,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f2c2121 >2013-12-09 14:21:02,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f2c2121 >2013-12-09 14:21:02,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e117350 >2013-12-09 14:21:02,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e117350 >2013-12-09 14:21:07,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1086abb2 >2013-12-09 14:21:08,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1086abb2 >2013-12-09 14:21:08,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e6643f6 >2013-12-09 14:21:08,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e6643f6 >2013-12-09 14:21:13,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17ea0030 >2013-12-09 14:21:13,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 17ea0030 >2013-12-09 14:21:13,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f317ff0 >2013-12-09 14:21:14,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f317ff0 >2013-12-09 14:21:19,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3159a02b >2013-12-09 14:21:19,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3159a02b >2013-12-09 14:21:19,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5226855 >2013-12-09 14:21:19,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5226855 >2013-12-09 14:21:24,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 22fe4f3a >2013-12-09 14:21:25,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 22fe4f3a >2013-12-09 14:21:25,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5798011c >2013-12-09 14:21:25,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5798011c >2013-12-09 14:21:30,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c134731 >2013-12-09 14:21:31,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: c134731 >2013-12-09 14:21:31,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c969307 >2013-12-09 14:21:31,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c969307 >2013-12-09 14:21:36,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76ed1796 >2013-12-09 14:21:37,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 76ed1796 >2013-12-09 14:21:37,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3eef3fd1 >2013-12-09 14:21:37,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3eef3fd1 >2013-12-09 14:21:42,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2caf71ec >2013-12-09 14:21:42,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2caf71ec >2013-12-09 14:21:42,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d2ad5a >2013-12-09 14:21:43,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d2ad5a >2013-12-09 14:21:48,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 688bb703 >2013-12-09 14:21:48,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 688bb703 >2013-12-09 14:21:48,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2585f292 >2013-12-09 14:21:48,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2585f292 >2013-12-09 14:21:53,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a92a89d >2013-12-09 14:21:54,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a92a89d >2013-12-09 14:21:54,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3bf01378 >2013-12-09 14:21:54,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3bf01378 >2013-12-09 14:21:59,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61554847 >2013-12-09 14:21:59,956 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-5) No up server in cluster >2013-12-09 14:21:59,956 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-5) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:21:59,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3264eac0 >2013-12-09 14:22:00,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 61554847 >2013-12-09 14:22:00,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e2000fd >2013-12-09 14:22:00,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3264eac0 >2013-12-09 14:22:00,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e2000fd >2013-12-09 14:22:05,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d125780 >2013-12-09 14:22:05,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d125780 >2013-12-09 14:22:05,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ef7a066 >2013-12-09 14:22:06,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ef7a066 >2013-12-09 14:22:11,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3369a67d >2013-12-09 14:22:11,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3369a67d >2013-12-09 14:22:11,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61f0852 >2013-12-09 14:22:12,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61f0852 >2013-12-09 14:22:17,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2199c7cc >2013-12-09 14:22:17,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2199c7cc >2013-12-09 14:22:17,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33601eb5 >2013-12-09 14:22:17,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33601eb5 >2013-12-09 14:22:22,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65e0f707 >2013-12-09 14:22:23,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 65e0f707 >2013-12-09 14:22:23,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 93c1a6d >2013-12-09 14:22:23,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 93c1a6d >2013-12-09 14:22:28,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 216925a9 >2013-12-09 14:22:29,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 216925a9 >2013-12-09 14:22:29,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7fb588af >2013-12-09 14:22:29,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fb588af >2013-12-09 14:22:34,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19dc9add >2013-12-09 14:22:34,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 19dc9add >2013-12-09 14:22:34,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 428643f7 >2013-12-09 14:22:35,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 428643f7 >2013-12-09 14:22:40,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f0d8d8c >2013-12-09 14:22:40,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f0d8d8c >2013-12-09 14:22:40,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f8139b8 >2013-12-09 14:22:40,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f8139b8 >2013-12-09 14:22:45,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6783907d >2013-12-09 14:22:46,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6783907d >2013-12-09 14:22:46,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3cbee813 >2013-12-09 14:22:46,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3cbee813 >2013-12-09 14:22:51,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 264ef6db >2013-12-09 14:22:52,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 264ef6db >2013-12-09 14:22:52,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56b62bd4 >2013-12-09 14:22:52,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56b62bd4 >2013-12-09 14:22:57,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 184a0842 >2013-12-09 14:22:57,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 184a0842 >2013-12-09 14:22:57,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 653a203d >2013-12-09 14:22:58,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 653a203d >2013-12-09 14:23:00,227 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) No up server in cluster >2013-12-09 14:23:00,228 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:23:00,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5519b912 >2013-12-09 14:23:00,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5519b912 >2013-12-09 14:23:03,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56c28baf >2013-12-09 14:23:03,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 56c28baf >2013-12-09 14:23:03,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48e6c9ad >2013-12-09 14:23:03,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48e6c9ad >2013-12-09 14:23:08,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38cb87e3 >2013-12-09 14:23:09,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 38cb87e3 >2013-12-09 14:23:09,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5cf9e9a9 >2013-12-09 14:23:09,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cf9e9a9 >2013-12-09 14:23:14,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d9df617 >2013-12-09 14:23:15,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d9df617 >2013-12-09 14:23:15,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 471fe402 >2013-12-09 14:23:15,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 471fe402 >2013-12-09 14:23:20,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35f39d8 >2013-12-09 14:23:21,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 35f39d8 >2013-12-09 14:23:21,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a715619 >2013-12-09 14:23:21,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a715619 >2013-12-09 14:23:26,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2999083 >2013-12-09 14:23:26,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2999083 >2013-12-09 14:23:26,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65bfe4ba >2013-12-09 14:23:27,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65bfe4ba >2013-12-09 14:23:32,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7104998c >2013-12-09 14:23:32,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7104998c >2013-12-09 14:23:32,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c1b778d >2013-12-09 14:23:32,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c1b778d >2013-12-09 14:23:37,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 637a6626 >2013-12-09 14:23:38,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 637a6626 >2013-12-09 14:23:38,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4cbc9490 >2013-12-09 14:23:38,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4cbc9490 >2013-12-09 14:23:43,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a1f9870 >2013-12-09 14:23:44,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a1f9870 >2013-12-09 14:23:44,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 25df74eb >2013-12-09 14:23:44,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25df74eb >2013-12-09 14:23:49,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66af9dd >2013-12-09 14:23:49,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 66af9dd >2013-12-09 14:23:50,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ca8490b >2013-12-09 14:23:50,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ca8490b >2013-12-09 14:23:55,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4506e5f7 >2013-12-09 14:23:55,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4506e5f7 >2013-12-09 14:23:55,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 426be43f >2013-12-09 14:23:56,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 426be43f >2013-12-09 14:24:00,514 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-74) No up server in cluster >2013-12-09 14:24:00,514 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-74) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:24:00,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1354bf58 >2013-12-09 14:24:00,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1354bf58 >2013-12-09 14:24:01,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61cb2701 >2013-12-09 14:24:01,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 61cb2701 >2013-12-09 14:24:01,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47ed5d56 >2013-12-09 14:24:01,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47ed5d56 >2013-12-09 14:24:06,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d225b3f >2013-12-09 14:24:07,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d225b3f >2013-12-09 14:24:07,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6342b4da >2013-12-09 14:24:07,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6342b4da >2013-12-09 14:24:12,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2890d483 >2013-12-09 14:24:13,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2890d483 >2013-12-09 14:24:13,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9cf976 >2013-12-09 14:24:13,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9cf976 >2013-12-09 14:24:18,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 212a9d48 >2013-12-09 14:24:18,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 212a9d48 >2013-12-09 14:24:18,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b59f220 >2013-12-09 14:24:19,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b59f220 >2013-12-09 14:24:24,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1892e213 >2013-12-09 14:24:24,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1892e213 >2013-12-09 14:24:24,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b24f12e >2013-12-09 14:24:24,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b24f12e >2013-12-09 14:24:29,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 450d07db >2013-12-09 14:24:30,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 450d07db >2013-12-09 14:24:30,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ee16131 >2013-12-09 14:24:30,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ee16131 >2013-12-09 14:24:35,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48cfd7d1 >2013-12-09 14:24:36,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 48cfd7d1 >2013-12-09 14:24:36,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52d5b540 >2013-12-09 14:24:36,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52d5b540 >2013-12-09 14:24:41,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 486193e2 >2013-12-09 14:24:42,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 486193e2 >2013-12-09 14:24:42,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a1879ea >2013-12-09 14:24:42,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a1879ea >2013-12-09 14:24:47,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e604301 >2013-12-09 14:24:47,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e604301 >2013-12-09 14:24:47,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77e27e46 >2013-12-09 14:24:48,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77e27e46 >2013-12-09 14:24:53,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 289e270c >2013-12-09 14:24:53,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 289e270c >2013-12-09 14:24:53,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6dd502e8 >2013-12-09 14:24:53,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6dd502e8 >2013-12-09 14:24:58,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 339857f9 >2013-12-09 14:24:59,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 339857f9 >2013-12-09 14:24:59,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30f0189b >2013-12-09 14:24:59,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30f0189b >2013-12-09 14:25:00,798 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-68) No up server in cluster >2013-12-09 14:25:00,798 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-68) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:25:00,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f279fa8 >2013-12-09 14:25:01,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2f279fa8 >2013-12-09 14:25:04,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f332de6 >2013-12-09 14:25:05,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: f332de6 >2013-12-09 14:25:05,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ea974ef >2013-12-09 14:25:05,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ea974ef >2013-12-09 14:25:10,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f3264ae >2013-12-09 14:25:10,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f3264ae >2013-12-09 14:25:10,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 211157fc >2013-12-09 14:25:11,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 211157fc >2013-12-09 14:25:16,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21eef86b >2013-12-09 14:25:16,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 21eef86b >2013-12-09 14:25:16,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e17072 >2013-12-09 14:25:16,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e17072 >2013-12-09 14:25:21,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fa3614c >2013-12-09 14:25:22,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2fa3614c >2013-12-09 14:25:22,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7eda48b0 >2013-12-09 14:25:22,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7eda48b0 >2013-12-09 14:25:27,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f149584 >2013-12-09 14:25:28,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f149584 >2013-12-09 14:25:28,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51ae098e >2013-12-09 14:25:28,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51ae098e >2013-12-09 14:25:33,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c740ca8 >2013-12-09 14:25:33,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1c740ca8 >2013-12-09 14:25:33,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d52c7f1 >2013-12-09 14:25:34,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d52c7f1 >2013-12-09 14:25:39,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d77f83c >2013-12-09 14:25:39,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d77f83c >2013-12-09 14:25:39,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7cace8c1 >2013-12-09 14:25:40,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7cace8c1 >2013-12-09 14:25:45,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16027005 >2013-12-09 14:25:45,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 16027005 >2013-12-09 14:25:45,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53423d82 >2013-12-09 14:25:45,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53423d82 >2013-12-09 14:25:50,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61070372 >2013-12-09 14:25:51,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 61070372 >2013-12-09 14:25:51,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58e2aabd >2013-12-09 14:25:51,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58e2aabd >2013-12-09 14:25:56,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e9671f5 >2013-12-09 14:25:57,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6e9671f5 >2013-12-09 14:25:57,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6859ad1c >2013-12-09 14:25:57,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6859ad1c >2013-12-09 14:26:01,073 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-27) No up server in cluster >2013-12-09 14:26:01,074 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-27) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:26:01,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56c1f15f >2013-12-09 14:26:01,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterTasksListVDSCommand, return: [], log id: 56c1f15f >2013-12-09 14:26:02,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 647e4abf >2013-12-09 14:26:02,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 647e4abf >2013-12-09 14:26:02,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6736f6ac >2013-12-09 14:26:03,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6736f6ac >2013-12-09 14:26:08,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 134d8e2a >2013-12-09 14:26:08,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 134d8e2a >2013-12-09 14:26:08,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f7f40d1 >2013-12-09 14:26:08,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f7f40d1 >2013-12-09 14:26:13,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 570ffefa >2013-12-09 14:26:14,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 570ffefa >2013-12-09 14:26:14,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f5407aa >2013-12-09 14:26:14,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f5407aa >2013-12-09 14:26:19,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e6c3246 >2013-12-09 14:26:20,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3e6c3246 >2013-12-09 14:26:20,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 464b511f >2013-12-09 14:26:20,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 464b511f >2013-12-09 14:26:25,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a1d8d49 >2013-12-09 14:26:25,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: a1d8d49 >2013-12-09 14:26:25,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68a05044 >2013-12-09 14:26:26,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68a05044 >2013-12-09 14:26:31,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 762af670 >2013-12-09 14:26:31,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 762af670 >2013-12-09 14:26:31,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5beb0305 >2013-12-09 14:26:32,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5beb0305 >2013-12-09 14:26:37,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39e8d531 >2013-12-09 14:26:37,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 39e8d531 >2013-12-09 14:26:37,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3993492 >2013-12-09 14:26:37,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3993492 >2013-12-09 14:26:42,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a53ff8 >2013-12-09 14:26:43,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: a53ff8 >2013-12-09 14:26:43,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a2e92d0 >2013-12-09 14:26:43,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a2e92d0 >2013-12-09 14:26:48,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68f0d39 >2013-12-09 14:26:49,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 68f0d39 >2013-12-09 14:26:49,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32e143f1 >2013-12-09 14:26:49,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32e143f1 >2013-12-09 14:26:54,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2edb2b85 >2013-12-09 14:26:54,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2edb2b85 >2013-12-09 14:26:54,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6499f7d9 >2013-12-09 14:26:55,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6499f7d9 >2013-12-09 14:27:00,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67aee8be >2013-12-09 14:27:00,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 67aee8be >2013-12-09 14:27:00,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37e0711d >2013-12-09 14:27:00,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37e0711d >2013-12-09 14:27:01,346 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-6) No up server in cluster >2013-12-09 14:27:01,346 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-6) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:27:01,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5eaad7 >2013-12-09 14:27:01,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5eaad7 >2013-12-09 14:27:05,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f96aeb0 >2013-12-09 14:27:06,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7f96aeb0 >2013-12-09 14:27:06,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b0edeb1 >2013-12-09 14:27:06,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b0edeb1 >2013-12-09 14:27:11,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62de9158 >2013-12-09 14:27:12,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 62de9158 >2013-12-09 14:27:12,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1800b315 >2013-12-09 14:27:12,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1800b315 >2013-12-09 14:27:17,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52d4dfb >2013-12-09 14:27:17,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 52d4dfb >2013-12-09 14:27:17,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4abe9382 >2013-12-09 14:27:18,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4abe9382 >2013-12-09 14:27:23,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f4b213e >2013-12-09 14:27:23,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1f4b213e >2013-12-09 14:27:23,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5115e9dd >2013-12-09 14:27:23,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5115e9dd >2013-12-09 14:27:28,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f3dfef6 >2013-12-09 14:27:29,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f3dfef6 >2013-12-09 14:27:29,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5288eb97 >2013-12-09 14:27:29,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5288eb97 >2013-12-09 14:27:34,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a626eca >2013-12-09 14:27:35,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2a626eca >2013-12-09 14:27:35,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4163ee4a >2013-12-09 14:27:35,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4163ee4a >2013-12-09 14:27:40,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78f3663d >2013-12-09 14:27:41,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 78f3663d >2013-12-09 14:27:41,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79eff951 >2013-12-09 14:27:41,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79eff951 >2013-12-09 14:27:46,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 81d976c >2013-12-09 14:27:46,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 81d976c >2013-12-09 14:27:46,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d229115 >2013-12-09 14:27:47,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d229115 >2013-12-09 14:27:52,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51ea194b >2013-12-09 14:27:52,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 51ea194b >2013-12-09 14:27:52,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 296b61c4 >2013-12-09 14:27:52,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 296b61c4 >2013-12-09 14:27:57,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 698fd69f >2013-12-09 14:27:58,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 698fd69f >2013-12-09 14:27:58,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49250732 >2013-12-09 14:27:58,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49250732 >2013-12-09 14:28:01,622 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-77) No up server in cluster >2013-12-09 14:28:01,622 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-77) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:28:01,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d0bf737 >2013-12-09 14:28:01,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1d0bf737 >2013-12-09 14:28:03,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7df15319 >2013-12-09 14:28:04,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7df15319 >2013-12-09 14:28:04,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 779e1f34 >2013-12-09 14:28:04,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 779e1f34 >2013-12-09 14:28:09,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16806a58 >2013-12-09 14:28:09,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 16806a58 >2013-12-09 14:28:09,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63b1949f >2013-12-09 14:28:10,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63b1949f >2013-12-09 14:28:15,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2671e251 >2013-12-09 14:28:15,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2671e251 >2013-12-09 14:28:15,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e9d79f9 >2013-12-09 14:28:16,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e9d79f9 >2013-12-09 14:28:21,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7bb83912 >2013-12-09 14:28:21,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7bb83912 >2013-12-09 14:28:21,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78793faa >2013-12-09 14:28:21,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78793faa >2013-12-09 14:28:26,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a0a1fa4 >2013-12-09 14:28:27,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a0a1fa4 >2013-12-09 14:28:27,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12c2ddbe >2013-12-09 14:28:27,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12c2ddbe >2013-12-09 14:28:32,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52749513 >2013-12-09 14:28:33,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 52749513 >2013-12-09 14:28:33,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7eef255b >2013-12-09 14:28:33,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7eef255b >2013-12-09 14:28:38,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f02051 >2013-12-09 14:28:38,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f02051 >2013-12-09 14:28:38,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f14f29e >2013-12-09 14:28:39,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f14f29e >2013-12-09 14:28:44,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78e09713 >2013-12-09 14:28:44,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 78e09713 >2013-12-09 14:28:44,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c116cfc >2013-12-09 14:28:44,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c116cfc >2013-12-09 14:28:49,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f9f11f >2013-12-09 14:28:50,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f9f11f >2013-12-09 14:28:50,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 685350f6 >2013-12-09 14:28:50,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 685350f6 >2013-12-09 14:28:55,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30715b73 >2013-12-09 14:28:56,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 30715b73 >2013-12-09 14:28:56,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f79c37a >2013-12-09 14:28:56,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f79c37a >2013-12-09 14:29:01,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d1d2249 >2013-12-09 14:29:01,910 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-88) No up server in cluster >2013-12-09 14:29:01,910 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-88) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:29:01,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6491e5df >2013-12-09 14:29:01,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5d1d2249 >2013-12-09 14:29:01,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51562218 >2013-12-09 14:29:02,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6491e5df >2013-12-09 14:29:02,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51562218 >2013-12-09 14:29:07,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d117d31 >2013-12-09 14:29:07,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d117d31 >2013-12-09 14:29:07,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17e9cc07 >2013-12-09 14:29:07,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17e9cc07 >2013-12-09 14:29:12,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27610859 >2013-12-09 14:29:13,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 27610859 >2013-12-09 14:29:13,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1acf99e >2013-12-09 14:29:13,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1acf99e >2013-12-09 14:29:18,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 702bbd6a >2013-12-09 14:29:19,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 702bbd6a >2013-12-09 14:29:19,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72de06ca >2013-12-09 14:29:19,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72de06ca >2013-12-09 14:29:24,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 713a1fe5 >2013-12-09 14:29:25,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 713a1fe5 >2013-12-09 14:29:25,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42844bcf >2013-12-09 14:29:25,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42844bcf >2013-12-09 14:29:30,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39e64890 >2013-12-09 14:29:30,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 39e64890 >2013-12-09 14:29:30,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74658ad8 >2013-12-09 14:29:31,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74658ad8 >2013-12-09 14:29:36,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f49af62 >2013-12-09 14:29:36,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f49af62 >2013-12-09 14:29:36,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 390ea234 >2013-12-09 14:29:36,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 390ea234 >2013-12-09 14:29:41,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 324d68f9 >2013-12-09 14:29:42,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 324d68f9 >2013-12-09 14:29:42,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4884189f >2013-12-09 14:29:42,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4884189f >2013-12-09 14:29:47,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 149ee4a2 >2013-12-09 14:29:48,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 149ee4a2 >2013-12-09 14:29:48,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26f5005d >2013-12-09 14:29:48,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26f5005d >2013-12-09 14:29:53,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48391d1 >2013-12-09 14:29:53,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 48391d1 >2013-12-09 14:29:53,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ef63a26 >2013-12-09 14:29:54,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ef63a26 >2013-12-09 14:29:59,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 502ce6e4 >2013-12-09 14:29:59,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 502ce6e4 >2013-12-09 14:29:59,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21d7d76 >2013-12-09 14:29:59,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21d7d76 >2013-12-09 14:30:02,168 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-100) No up server in cluster >2013-12-09 14:30:02,169 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-100) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:30:02,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1901ac23 >2013-12-09 14:30:02,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1901ac23 >2013-12-09 14:30:04,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5165cfb5 >2013-12-09 14:30:05,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5165cfb5 >2013-12-09 14:30:05,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11e741ba >2013-12-09 14:30:05,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11e741ba >2013-12-09 14:30:10,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5163c92e >2013-12-09 14:30:11,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5163c92e >2013-12-09 14:30:11,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19b34a75 >2013-12-09 14:30:11,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19b34a75 >2013-12-09 14:30:16,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a8e8a43 >2013-12-09 14:30:17,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a8e8a43 >2013-12-09 14:30:17,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ab98dc9 >2013-12-09 14:30:17,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ab98dc9 >2013-12-09 14:30:22,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67093e97 >2013-12-09 14:30:22,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 67093e97 >2013-12-09 14:30:22,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4cccceea >2013-12-09 14:30:23,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4cccceea >2013-12-09 14:30:28,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 524b5ee0 >2013-12-09 14:30:28,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 524b5ee0 >2013-12-09 14:30:28,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 22928eea >2013-12-09 14:30:28,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22928eea >2013-12-09 14:30:33,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1840cdc8 >2013-12-09 14:30:34,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1840cdc8 >2013-12-09 14:30:34,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56fad682 >2013-12-09 14:30:34,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56fad682 >2013-12-09 14:30:39,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41c6c381 >2013-12-09 14:30:40,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 41c6c381 >2013-12-09 14:30:40,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2cdd6e9c >2013-12-09 14:30:40,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2cdd6e9c >2013-12-09 14:30:45,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d83041c >2013-12-09 14:30:45,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d83041c >2013-12-09 14:30:45,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 711c401f >2013-12-09 14:30:46,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 711c401f >2013-12-09 14:30:51,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31f34f9b >2013-12-09 14:30:51,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 31f34f9b >2013-12-09 14:30:51,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18951de >2013-12-09 14:30:52,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18951de >2013-12-09 14:30:57,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19af35d4 >2013-12-09 14:30:57,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 19af35d4 >2013-12-09 14:30:57,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48f61d89 >2013-12-09 14:30:57,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48f61d89 >2013-12-09 14:31:02,447 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-22) No up server in cluster >2013-12-09 14:31:02,447 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-22) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:31:02,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50898af7 >2013-12-09 14:31:02,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterTasksListVDSCommand, return: [], log id: 50898af7 >2013-12-09 14:31:02,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ba14840 >2013-12-09 14:31:03,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ba14840 >2013-12-09 14:31:03,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c3207b2 >2013-12-09 14:31:03,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c3207b2 >2013-12-09 14:31:08,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b547445 >2013-12-09 14:31:09,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b547445 >2013-12-09 14:31:09,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4fd51796 >2013-12-09 14:31:09,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fd51796 >2013-12-09 14:31:14,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5989f101 >2013-12-09 14:31:14,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5989f101 >2013-12-09 14:31:14,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45967b1b >2013-12-09 14:31:15,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45967b1b >2013-12-09 14:31:20,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21a6f08 >2013-12-09 14:31:20,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 21a6f08 >2013-12-09 14:31:20,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66c6ca91 >2013-12-09 14:31:20,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66c6ca91 >2013-12-09 14:31:25,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20f94b1 >2013-12-09 14:31:26,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 20f94b1 >2013-12-09 14:31:26,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67539d81 >2013-12-09 14:31:26,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67539d81 >2013-12-09 14:31:31,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f9074df >2013-12-09 14:31:32,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6f9074df >2013-12-09 14:31:32,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d3d7a8a >2013-12-09 14:31:32,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d3d7a8a >2013-12-09 14:31:37,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 176ad494 >2013-12-09 14:31:37,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 176ad494 >2013-12-09 14:31:37,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68b74a05 >2013-12-09 14:31:38,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68b74a05 >2013-12-09 14:31:43,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58f1710a >2013-12-09 14:31:43,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 58f1710a >2013-12-09 14:31:43,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 147c8722 >2013-12-09 14:31:43,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 147c8722 >2013-12-09 14:31:48,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: af00f2f >2013-12-09 14:31:49,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: af00f2f >2013-12-09 14:31:49,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53e2164a >2013-12-09 14:31:49,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53e2164a >2013-12-09 14:31:54,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58fc8d3c >2013-12-09 14:31:55,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 58fc8d3c >2013-12-09 14:31:55,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67c83cec >2013-12-09 14:31:55,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67c83cec >2013-12-09 14:32:00,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35314c7a >2013-12-09 14:32:00,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 35314c7a >2013-12-09 14:32:00,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ae5e6bf >2013-12-09 14:32:01,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ae5e6bf >2013-12-09 14:32:02,731 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-42) No up server in cluster >2013-12-09 14:32:02,731 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-42) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:32:02,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ab1ed1e >2013-12-09 14:32:03,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2ab1ed1e >2013-12-09 14:32:06,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 115a4b3c >2013-12-09 14:32:06,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 115a4b3c >2013-12-09 14:32:06,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47fdbf43 >2013-12-09 14:32:06,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47fdbf43 >2013-12-09 14:32:12,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 186201fb >2013-12-09 14:32:12,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 186201fb >2013-12-09 14:32:12,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6618e0ba >2013-12-09 14:32:12,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6618e0ba >2013-12-09 14:32:17,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6bb409ca >2013-12-09 14:32:18,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6bb409ca >2013-12-09 14:32:18,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b06f6fe >2013-12-09 14:32:18,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b06f6fe >2013-12-09 14:32:23,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f8d5c7 >2013-12-09 14:32:24,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f8d5c7 >2013-12-09 14:32:24,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f728e85 >2013-12-09 14:32:24,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f728e85 >2013-12-09 14:32:29,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46d01760 >2013-12-09 14:32:29,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 46d01760 >2013-12-09 14:32:29,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68a4ba9a >2013-12-09 14:32:30,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68a4ba9a >2013-12-09 14:32:35,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30663b73 >2013-12-09 14:32:35,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 30663b73 >2013-12-09 14:32:35,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f96bd78 >2013-12-09 14:32:35,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f96bd78 >2013-12-09 14:32:40,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3cba2b5b >2013-12-09 14:32:41,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3cba2b5b >2013-12-09 14:32:41,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2782d263 >2013-12-09 14:32:41,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2782d263 >2013-12-09 14:32:46,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1353b117 >2013-12-09 14:32:47,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1353b117 >2013-12-09 14:32:47,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b1bb348 >2013-12-09 14:32:47,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b1bb348 >2013-12-09 14:32:52,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 581e199e >2013-12-09 14:32:53,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 581e199e >2013-12-09 14:32:53,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 82de0a9 >2013-12-09 14:32:53,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 82de0a9 >2013-12-09 14:32:58,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77c33f7f >2013-12-09 14:32:58,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 77c33f7f >2013-12-09 14:32:58,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3905106b >2013-12-09 14:32:59,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3905106b >2013-12-09 14:33:03,007 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-98) No up server in cluster >2013-12-09 14:33:03,007 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-98) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:33:03,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42e65afd >2013-12-09 14:33:03,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterTasksListVDSCommand, return: [], log id: 42e65afd >2013-12-09 14:33:04,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a3723a >2013-12-09 14:33:04,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a3723a >2013-12-09 14:33:04,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 685f713e >2013-12-09 14:33:04,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 685f713e >2013-12-09 14:33:09,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2311b388 >2013-12-09 14:33:10,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2311b388 >2013-12-09 14:33:10,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f0884ac >2013-12-09 14:33:10,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f0884ac >2013-12-09 14:33:15,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d815bc >2013-12-09 14:33:16,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d815bc >2013-12-09 14:33:16,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 141a6ae0 >2013-12-09 14:33:16,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 141a6ae0 >2013-12-09 14:33:21,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c6a53e5 >2013-12-09 14:33:21,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4c6a53e5 >2013-12-09 14:33:21,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e359bfe >2013-12-09 14:33:22,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e359bfe >2013-12-09 14:33:27,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35850cef >2013-12-09 14:33:27,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 35850cef >2013-12-09 14:33:27,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74f7f9d6 >2013-12-09 14:33:27,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74f7f9d6 >2013-12-09 14:33:32,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3bbad977 >2013-12-09 14:33:33,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3bbad977 >2013-12-09 14:33:33,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45567594 >2013-12-09 14:33:33,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45567594 >2013-12-09 14:33:38,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6de35c9c >2013-12-09 14:33:39,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6de35c9c >2013-12-09 14:33:39,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1654bf2d >2013-12-09 14:33:39,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1654bf2d >2013-12-09 14:33:44,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 582f4544 >2013-12-09 14:33:44,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 582f4544 >2013-12-09 14:33:44,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d6fc21a >2013-12-09 14:33:45,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d6fc21a >2013-12-09 14:33:50,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 49c4bae5 >2013-12-09 14:33:50,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 49c4bae5 >2013-12-09 14:33:50,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 277958ce >2013-12-09 14:33:51,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 277958ce >2013-12-09 14:33:56,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a694a9d >2013-12-09 14:33:56,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3a694a9d >2013-12-09 14:33:56,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3502a175 >2013-12-09 14:33:56,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3502a175 >2013-12-09 14:34:01,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ed79185 >2013-12-09 14:34:02,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6ed79185 >2013-12-09 14:34:02,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c1811d9 >2013-12-09 14:34:02,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c1811d9 >2013-12-09 14:34:03,275 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-77) No up server in cluster >2013-12-09 14:34:03,275 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-77) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:34:03,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7741cd98 >2013-12-09 14:34:03,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7741cd98 >2013-12-09 14:34:07,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46207d09 >2013-12-09 14:34:08,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 46207d09 >2013-12-09 14:34:08,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2409cfef >2013-12-09 14:34:08,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2409cfef >2013-12-09 14:34:13,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 331e6927 >2013-12-09 14:34:13,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 331e6927 >2013-12-09 14:34:13,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78e032c >2013-12-09 14:34:14,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78e032c >2013-12-09 14:34:19,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55369202 >2013-12-09 14:34:19,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 55369202 >2013-12-09 14:34:19,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 429fdf20 >2013-12-09 14:34:19,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 429fdf20 >2013-12-09 14:34:24,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d9b22aa >2013-12-09 14:34:25,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d9b22aa >2013-12-09 14:34:25,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ac83f1f >2013-12-09 14:34:25,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ac83f1f >2013-12-09 14:34:30,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 937ae11 >2013-12-09 14:34:31,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 937ae11 >2013-12-09 14:34:31,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16f93297 >2013-12-09 14:34:31,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16f93297 >2013-12-09 14:34:36,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e315da8 >2013-12-09 14:34:36,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6e315da8 >2013-12-09 14:34:36,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 281c417c >2013-12-09 14:34:37,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 281c417c >2013-12-09 14:34:42,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5597ac0a >2013-12-09 14:34:42,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5597ac0a >2013-12-09 14:34:42,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 192c1868 >2013-12-09 14:34:42,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 192c1868 >2013-12-09 14:34:47,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a46ab94 >2013-12-09 14:34:48,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a46ab94 >2013-12-09 14:34:48,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a1968b3 >2013-12-09 14:34:48,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a1968b3 >2013-12-09 14:34:53,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ca31514 >2013-12-09 14:34:54,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ca31514 >2013-12-09 14:34:54,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 665d4b55 >2013-12-09 14:34:54,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 665d4b55 >2013-12-09 14:34:59,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a4f99f7 >2013-12-09 14:35:00,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6a4f99f7 >2013-12-09 14:35:00,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e42e07e >2013-12-09 14:35:00,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e42e07e >2013-12-09 14:35:03,548 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-88) No up server in cluster >2013-12-09 14:35:03,548 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-88) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:35:03,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57ecd9f1 >2013-12-09 14:35:03,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterTasksListVDSCommand, return: [], log id: 57ecd9f1 >2013-12-09 14:35:05,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45206b03 >2013-12-09 14:35:05,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 45206b03 >2013-12-09 14:35:05,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ff4f33f >2013-12-09 14:35:06,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ff4f33f >2013-12-09 14:35:11,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6cc8ede0 >2013-12-09 14:35:11,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6cc8ede0 >2013-12-09 14:35:11,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45553e9f >2013-12-09 14:35:11,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45553e9f >2013-12-09 14:35:16,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47782623 >2013-12-09 14:35:17,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 47782623 >2013-12-09 14:35:17,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55f54c53 >2013-12-09 14:35:17,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55f54c53 >2013-12-09 14:35:22,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2091c0bf >2013-12-09 14:35:23,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2091c0bf >2013-12-09 14:35:23,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45b638b0 >2013-12-09 14:35:23,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45b638b0 >2013-12-09 14:35:28,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 225d6a3 >2013-12-09 14:35:29,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 225d6a3 >2013-12-09 14:35:29,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42a0920 >2013-12-09 14:35:29,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42a0920 >2013-12-09 14:35:34,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29a534a8 >2013-12-09 14:35:34,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 29a534a8 >2013-12-09 14:35:34,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 16106a8e >2013-12-09 14:35:35,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16106a8e >2013-12-09 14:35:40,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f134a83 >2013-12-09 14:35:40,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5f134a83 >2013-12-09 14:35:40,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5fc13896 >2013-12-09 14:35:40,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fc13896 >2013-12-09 14:35:45,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d8eb7e3 >2013-12-09 14:35:46,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d8eb7e3 >2013-12-09 14:35:46,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3fa6f467 >2013-12-09 14:35:46,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3fa6f467 >2013-12-09 14:35:51,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c3c9b1a >2013-12-09 14:35:52,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c3c9b1a >2013-12-09 14:35:52,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66b62872 >2013-12-09 14:35:52,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66b62872 >2013-12-09 14:35:57,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 556c8091 >2013-12-09 14:35:57,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 556c8091 >2013-12-09 14:35:57,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f901bf8 >2013-12-09 14:35:58,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f901bf8 >2013-12-09 14:36:03,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ecde246 >2013-12-09 14:36:03,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ecde246 >2013-12-09 14:36:03,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71df8aee >2013-12-09 14:36:03,832 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-50) No up server in cluster >2013-12-09 14:36:03,832 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-50) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:36:03,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6935edce >2013-12-09 14:36:03,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71df8aee >2013-12-09 14:36:04,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6935edce >2013-12-09 14:36:09,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a6edc5b >2013-12-09 14:36:09,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7a6edc5b >2013-12-09 14:36:09,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7885a663 >2013-12-09 14:36:09,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7885a663 >2013-12-09 14:36:14,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53adcc56 >2013-12-09 14:36:15,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 53adcc56 >2013-12-09 14:36:15,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11c69b54 >2013-12-09 14:36:15,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11c69b54 >2013-12-09 14:36:20,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f22c35a >2013-12-09 14:36:21,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7f22c35a >2013-12-09 14:36:21,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3aff6480 >2013-12-09 14:36:21,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3aff6480 >2013-12-09 14:36:26,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39151b3a >2013-12-09 14:36:26,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 39151b3a >2013-12-09 14:36:26,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c48dcb8 >2013-12-09 14:36:27,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c48dcb8 >2013-12-09 14:36:32,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4181c01d >2013-12-09 14:36:32,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4181c01d >2013-12-09 14:36:32,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d5cdc6 >2013-12-09 14:36:32,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d5cdc6 >2013-12-09 14:36:37,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f93c943 >2013-12-09 14:36:38,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3f93c943 >2013-12-09 14:36:38,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 392463e6 >2013-12-09 14:36:38,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 392463e6 >2013-12-09 14:36:43,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bbb6b78 >2013-12-09 14:36:44,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4bbb6b78 >2013-12-09 14:36:44,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1cb67baf >2013-12-09 14:36:44,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1cb67baf >2013-12-09 14:36:49,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 714cdc9f >2013-12-09 14:36:49,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 714cdc9f >2013-12-09 14:36:49,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a197b09 >2013-12-09 14:36:50,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a197b09 >2013-12-09 14:36:55,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1dc49db1 >2013-12-09 14:36:55,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1dc49db1 >2013-12-09 14:36:55,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3aa1c18f >2013-12-09 14:36:55,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3aa1c18f >2013-12-09 14:37:00,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f6c876d >2013-12-09 14:37:01,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7f6c876d >2013-12-09 14:37:01,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b1ec242 >2013-12-09 14:37:01,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b1ec242 >2013-12-09 14:37:04,098 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-84) No up server in cluster >2013-12-09 14:37:04,098 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-84) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:37:04,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d99e4db >2013-12-09 14:37:04,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterTasksListVDSCommand, return: [], log id: d99e4db >2013-12-09 14:37:06,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1363c2c8 >2013-12-09 14:37:07,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1363c2c8 >2013-12-09 14:37:07,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e3e31fa >2013-12-09 14:37:07,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e3e31fa >2013-12-09 14:37:12,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a8c6ab9 >2013-12-09 14:37:12,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a8c6ab9 >2013-12-09 14:37:12,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5df690e4 >2013-12-09 14:37:13,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5df690e4 >2013-12-09 14:37:18,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59849e72 >2013-12-09 14:37:18,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59849e72 >2013-12-09 14:37:18,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52117085 >2013-12-09 14:37:19,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52117085 >2013-12-09 14:37:24,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74f92ed0 >2013-12-09 14:37:24,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 74f92ed0 >2013-12-09 14:37:24,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e43e148 >2013-12-09 14:37:24,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e43e148 >2013-12-09 14:37:29,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52a7079 >2013-12-09 14:37:30,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 52a7079 >2013-12-09 14:37:30,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8ddcb82 >2013-12-09 14:37:30,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8ddcb82 >2013-12-09 14:37:35,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b9d9dbf >2013-12-09 14:37:36,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5b9d9dbf >2013-12-09 14:37:36,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31dd5c21 >2013-12-09 14:37:36,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31dd5c21 >2013-12-09 14:37:41,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6881982 >2013-12-09 14:37:41,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6881982 >2013-12-09 14:37:41,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62b89a69 >2013-12-09 14:37:42,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62b89a69 >2013-12-09 14:37:47,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a2b929b >2013-12-09 14:37:47,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2a2b929b >2013-12-09 14:37:47,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 337cd1f1 >2013-12-09 14:37:47,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 337cd1f1 >2013-12-09 14:37:52,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48dcf87b >2013-12-09 14:37:53,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 48dcf87b >2013-12-09 14:37:53,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67dc9ec1 >2013-12-09 14:37:53,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67dc9ec1 >2013-12-09 14:37:58,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40c384e7 >2013-12-09 14:37:59,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 40c384e7 >2013-12-09 14:37:59,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ddcd96 >2013-12-09 14:37:59,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ddcd96 >2013-12-09 14:38:04,377 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-72) No up server in cluster >2013-12-09 14:38:04,377 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-72) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:38:04,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2fa93d97 >2013-12-09 14:38:04,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41e1bc2f >2013-12-09 14:38:04,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2fa93d97 >2013-12-09 14:38:04,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 41e1bc2f >2013-12-09 14:38:04,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1db624a9 >2013-12-09 14:38:05,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1db624a9 >2013-12-09 14:38:10,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76b9df0d >2013-12-09 14:38:10,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 76b9df0d >2013-12-09 14:38:10,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bb62613 >2013-12-09 14:38:11,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4bb62613 >2013-12-09 14:38:16,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54db2af1 >2013-12-09 14:38:16,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 54db2af1 >2013-12-09 14:38:16,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b4c2c12 >2013-12-09 14:38:16,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b4c2c12 >2013-12-09 14:38:21,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64f69601 >2013-12-09 14:38:22,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 64f69601 >2013-12-09 14:38:22,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12010e8c >2013-12-09 14:38:22,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12010e8c >2013-12-09 14:38:27,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3001e15e >2013-12-09 14:38:28,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3001e15e >2013-12-09 14:38:28,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 372d84d1 >2013-12-09 14:38:28,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 372d84d1 >2013-12-09 14:38:33,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b189135 >2013-12-09 14:38:33,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b189135 >2013-12-09 14:38:33,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4af01053 >2013-12-09 14:38:34,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4af01053 >2013-12-09 14:38:39,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c064b28 >2013-12-09 14:38:39,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c064b28 >2013-12-09 14:38:39,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ab5000f >2013-12-09 14:38:39,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ab5000f >2013-12-09 14:38:44,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 138b33e1 >2013-12-09 14:38:45,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 138b33e1 >2013-12-09 14:38:45,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 731693ea >2013-12-09 14:38:45,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 731693ea >2013-12-09 14:38:50,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c1a9407 >2013-12-09 14:38:51,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c1a9407 >2013-12-09 14:38:51,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47ca5df3 >2013-12-09 14:38:51,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47ca5df3 >2013-12-09 14:38:56,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a0cf535 >2013-12-09 14:38:56,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a0cf535 >2013-12-09 14:38:56,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28fcbad9 >2013-12-09 14:38:57,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28fcbad9 >2013-12-09 14:39:02,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4810895f >2013-12-09 14:39:02,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4810895f >2013-12-09 14:39:02,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e96c386 >2013-12-09 14:39:02,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e96c386 >2013-12-09 14:39:04,891 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-45) No up server in cluster >2013-12-09 14:39:04,891 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-45) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:39:04,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53cbf3c7 >2013-12-09 14:39:05,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterTasksListVDSCommand, return: [], log id: 53cbf3c7 >2013-12-09 14:39:07,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 25d84ea7 >2013-12-09 14:39:08,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 25d84ea7 >2013-12-09 14:39:08,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fcbafe3 >2013-12-09 14:39:08,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fcbafe3 >2013-12-09 14:39:13,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 643dd750 >2013-12-09 14:39:14,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 643dd750 >2013-12-09 14:39:14,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ae8f3d7 >2013-12-09 14:39:14,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ae8f3d7 >2013-12-09 14:39:19,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 196e5cd4 >2013-12-09 14:39:20,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 196e5cd4 >2013-12-09 14:39:20,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b3a6c52 >2013-12-09 14:39:20,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b3a6c52 >2013-12-09 14:39:25,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d4bdaa8 >2013-12-09 14:39:25,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6d4bdaa8 >2013-12-09 14:39:25,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2103f6ad >2013-12-09 14:39:26,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2103f6ad >2013-12-09 14:39:31,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6300f0b7 >2013-12-09 14:39:31,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6300f0b7 >2013-12-09 14:39:31,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6dd0ff5d >2013-12-09 14:39:31,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6dd0ff5d >2013-12-09 14:39:36,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74e46b8 >2013-12-09 14:39:37,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 74e46b8 >2013-12-09 14:39:37,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79c34128 >2013-12-09 14:39:37,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79c34128 >2013-12-09 14:39:42,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d26638c >2013-12-09 14:39:43,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d26638c >2013-12-09 14:39:43,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4edb2df9 >2013-12-09 14:39:43,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4edb2df9 >2013-12-09 14:39:48,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: dc957eb >2013-12-09 14:39:48,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: dc957eb >2013-12-09 14:39:48,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c1e5d9b >2013-12-09 14:39:49,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c1e5d9b >2013-12-09 14:39:54,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 537fa62f >2013-12-09 14:39:54,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 537fa62f >2013-12-09 14:39:54,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 392562fe >2013-12-09 14:39:54,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 392562fe >2013-12-09 14:39:59,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7450a332 >2013-12-09 14:40:00,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7450a332 >2013-12-09 14:40:00,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e2cf93d >2013-12-09 14:40:00,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e2cf93d >2013-12-09 14:40:05,165 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) No up server in cluster >2013-12-09 14:40:05,166 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:40:05,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a376603 >2013-12-09 14:40:05,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5a376603 >2013-12-09 14:40:05,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17d914d >2013-12-09 14:40:06,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 17d914d >2013-12-09 14:40:06,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c7ede2c >2013-12-09 14:40:06,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c7ede2c >2013-12-09 14:40:11,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 746ccdcf >2013-12-09 14:40:12,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 746ccdcf >2013-12-09 14:40:12,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 365f79eb >2013-12-09 14:40:12,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 365f79eb >2013-12-09 14:40:17,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b18f71a >2013-12-09 14:40:17,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b18f71a >2013-12-09 14:40:17,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34778282 >2013-12-09 14:40:18,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34778282 >2013-12-09 14:40:23,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d3dcb9e >2013-12-09 14:40:23,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d3dcb9e >2013-12-09 14:40:23,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d662acc >2013-12-09 14:40:23,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d662acc >2013-12-09 14:40:28,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 513492c2 >2013-12-09 14:40:29,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 513492c2 >2013-12-09 14:40:29,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d4a1ae1 >2013-12-09 14:40:29,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d4a1ae1 >2013-12-09 14:40:34,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42b7f09b >2013-12-09 14:40:35,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 42b7f09b >2013-12-09 14:40:35,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5fbe4a39 >2013-12-09 14:40:35,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fbe4a39 >2013-12-09 14:40:40,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 367820c9 >2013-12-09 14:40:40,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 367820c9 >2013-12-09 14:40:40,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c48263f >2013-12-09 14:40:41,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c48263f >2013-12-09 14:40:46,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3bd40433 >2013-12-09 14:40:46,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3bd40433 >2013-12-09 14:40:46,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c6dd4e6 >2013-12-09 14:40:46,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c6dd4e6 >2013-12-09 14:40:51,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c0b7626 >2013-12-09 14:40:52,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3c0b7626 >2013-12-09 14:40:52,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56811a48 >2013-12-09 14:40:52,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56811a48 >2013-12-09 14:40:57,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b8e8cba >2013-12-09 14:40:58,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1b8e8cba >2013-12-09 14:40:58,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3afd1258 >2013-12-09 14:40:58,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3afd1258 >2013-12-09 14:41:03,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f11b0b8 >2013-12-09 14:41:03,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: f11b0b8 >2013-12-09 14:41:03,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59598058 >2013-12-09 14:41:04,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59598058 >2013-12-09 14:41:05,448 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-39) [63f3d095] No up server in cluster >2013-12-09 14:41:05,448 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-39) [63f3d095] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:41:05,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 319984 >2013-12-09 14:41:05,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterTasksListVDSCommand, return: [], log id: 319984 >2013-12-09 14:41:09,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 517c87fb >2013-12-09 14:41:09,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 517c87fb >2013-12-09 14:41:09,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f6eb281 >2013-12-09 14:41:09,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f6eb281 >2013-12-09 14:41:15,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54723a97 >2013-12-09 14:41:15,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 54723a97 >2013-12-09 14:41:15,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37f06315 >2013-12-09 14:41:15,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37f06315 >2013-12-09 14:41:20,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 565ca56b >2013-12-09 14:41:21,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 565ca56b >2013-12-09 14:41:21,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72b83893 >2013-12-09 14:41:21,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72b83893 >2013-12-09 14:41:26,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1dde36d4 >2013-12-09 14:41:27,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1dde36d4 >2013-12-09 14:41:27,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c6caa74 >2013-12-09 14:41:27,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c6caa74 >2013-12-09 14:41:32,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 475865be >2013-12-09 14:41:32,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 475865be >2013-12-09 14:41:32,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19952c65 >2013-12-09 14:41:33,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19952c65 >2013-12-09 14:41:38,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71577ca7 >2013-12-09 14:41:38,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 71577ca7 >2013-12-09 14:41:38,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f75c68b >2013-12-09 14:41:38,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f75c68b >2013-12-09 14:41:43,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3bb8424d >2013-12-09 14:41:44,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3bb8424d >2013-12-09 14:41:44,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 539af8e3 >2013-12-09 14:41:44,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 539af8e3 >2013-12-09 14:41:49,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d80ae2b >2013-12-09 14:41:50,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d80ae2b >2013-12-09 14:41:50,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d80ff41 >2013-12-09 14:41:50,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d80ff41 >2013-12-09 14:41:55,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a1593f5 >2013-12-09 14:41:55,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a1593f5 >2013-12-09 14:41:55,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ef4d2eb >2013-12-09 14:41:56,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ef4d2eb >2013-12-09 14:42:01,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6cccf320 >2013-12-09 14:42:01,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6cccf320 >2013-12-09 14:42:01,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73a394e7 >2013-12-09 14:42:01,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73a394e7 >2013-12-09 14:42:05,729 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-3) [6d1f044] No up server in cluster >2013-12-09 14:42:05,729 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-3) [6d1f044] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:42:05,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b8aa415 >2013-12-09 14:42:06,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterTasksListVDSCommand, return: [], log id: 5b8aa415 >2013-12-09 14:42:06,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72aab201 >2013-12-09 14:42:07,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 72aab201 >2013-12-09 14:42:07,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f8d6d08 >2013-12-09 14:42:07,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f8d6d08 >2013-12-09 14:42:12,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 479b94af >2013-12-09 14:42:13,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 479b94af >2013-12-09 14:42:13,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42aff6d4 >2013-12-09 14:42:13,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42aff6d4 >2013-12-09 14:42:18,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: cf37710 >2013-12-09 14:42:19,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: cf37710 >2013-12-09 14:42:19,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 757200e0 >2013-12-09 14:42:19,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 757200e0 >2013-12-09 14:42:24,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4539d490 >2013-12-09 14:42:24,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4539d490 >2013-12-09 14:42:24,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16aba75a >2013-12-09 14:42:25,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16aba75a >2013-12-09 14:42:30,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 231bab85 >2013-12-09 14:42:30,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 231bab85 >2013-12-09 14:42:30,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53056118 >2013-12-09 14:42:30,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53056118 >2013-12-09 14:42:35,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1317f6d8 >2013-12-09 14:42:36,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1317f6d8 >2013-12-09 14:42:36,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a495dcd >2013-12-09 14:42:36,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a495dcd >2013-12-09 14:42:41,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f5ac576 >2013-12-09 14:42:42,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3f5ac576 >2013-12-09 14:42:42,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e32ce80 >2013-12-09 14:42:42,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e32ce80 >2013-12-09 14:42:47,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e61dcc6 >2013-12-09 14:42:47,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2e61dcc6 >2013-12-09 14:42:47,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15836cef >2013-12-09 14:42:48,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15836cef >2013-12-09 14:42:53,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5965da60 >2013-12-09 14:42:53,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5965da60 >2013-12-09 14:42:53,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c37864c >2013-12-09 14:42:53,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c37864c >2013-12-09 14:42:58,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2874674f >2013-12-09 14:42:59,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2874674f >2013-12-09 14:42:59,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a0c5d4f >2013-12-09 14:42:59,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a0c5d4f >2013-12-09 14:43:04,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b64b978 >2013-12-09 14:43:05,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b64b978 >2013-12-09 14:43:05,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c9d09e6 >2013-12-09 14:43:05,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c9d09e6 >2013-12-09 14:43:06,018 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-75) No up server in cluster >2013-12-09 14:43:06,018 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-75) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:43:06,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 537de2be >2013-12-09 14:43:06,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterTasksListVDSCommand, return: [], log id: 537de2be >2013-12-09 14:43:10,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3cca20a9 >2013-12-09 14:43:11,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3cca20a9 >2013-12-09 14:43:11,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52b621d0 >2013-12-09 14:43:11,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52b621d0 >2013-12-09 14:43:16,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 500f2957 >2013-12-09 14:43:16,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 500f2957 >2013-12-09 14:43:16,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75278014 >2013-12-09 14:43:17,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75278014 >2013-12-09 14:43:22,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 146c81f2 >2013-12-09 14:43:22,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 146c81f2 >2013-12-09 14:43:22,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 253b650e >2013-12-09 14:43:22,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 253b650e >2013-12-09 14:43:27,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5fcc3db6 >2013-12-09 14:43:28,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5fcc3db6 >2013-12-09 14:43:28,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d880a04 >2013-12-09 14:43:28,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d880a04 >2013-12-09 14:43:33,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: aa947d9 >2013-12-09 14:43:34,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: aa947d9 >2013-12-09 14:43:34,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a050a50 >2013-12-09 14:43:34,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a050a50 >2013-12-09 14:43:39,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78069ad3 >2013-12-09 14:43:39,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 78069ad3 >2013-12-09 14:43:39,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68c3cde6 >2013-12-09 14:43:40,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68c3cde6 >2013-12-09 14:43:45,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70dd66fe >2013-12-09 14:43:45,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 70dd66fe >2013-12-09 14:43:45,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e6a679d >2013-12-09 14:43:46,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e6a679d >2013-12-09 14:43:51,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 212baf50 >2013-12-09 14:43:51,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 212baf50 >2013-12-09 14:43:51,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47221922 >2013-12-09 14:43:51,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47221922 >2013-12-09 14:43:56,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a9e5748 >2013-12-09 14:43:57,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1a9e5748 >2013-12-09 14:43:57,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75feb191 >2013-12-09 14:43:57,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75feb191 >2013-12-09 14:44:02,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70deee58 >2013-12-09 14:44:03,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 70deee58 >2013-12-09 14:44:03,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70a6f37a >2013-12-09 14:44:03,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70a6f37a >2013-12-09 14:44:06,307 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-26) No up server in cluster >2013-12-09 14:44:06,307 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-26) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:44:06,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d39a087 >2013-12-09 14:44:06,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4d39a087 >2013-12-09 14:44:08,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c1965b0 >2013-12-09 14:44:08,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: c1965b0 >2013-12-09 14:44:08,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77c6d551 >2013-12-09 14:44:09,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77c6d551 >2013-12-09 14:44:14,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f62ad86 >2013-12-09 14:44:14,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f62ad86 >2013-12-09 14:44:14,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b69bb12 >2013-12-09 14:44:14,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b69bb12 >2013-12-09 14:44:19,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 126e2633 >2013-12-09 14:44:20,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 126e2633 >2013-12-09 14:44:20,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c9ca4c9 >2013-12-09 14:44:20,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c9ca4c9 >2013-12-09 14:44:25,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 678ffadc >2013-12-09 14:44:26,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 678ffadc >2013-12-09 14:44:26,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ff67359 >2013-12-09 14:44:26,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ff67359 >2013-12-09 14:44:31,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1edc8137 >2013-12-09 14:44:31,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1edc8137 >2013-12-09 14:44:31,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f6c453b >2013-12-09 14:44:32,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f6c453b >2013-12-09 14:44:37,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18557a0b >2013-12-09 14:44:37,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 18557a0b >2013-12-09 14:44:37,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5045d4e9 >2013-12-09 14:44:38,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5045d4e9 >2013-12-09 14:44:43,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2586e125 >2013-12-09 14:44:43,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2586e125 >2013-12-09 14:44:43,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d37b61e >2013-12-09 14:44:43,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d37b61e >2013-12-09 14:44:48,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ecde9ef >2013-12-09 14:44:49,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5ecde9ef >2013-12-09 14:44:49,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a500363 >2013-12-09 14:44:49,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a500363 >2013-12-09 14:44:54,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2fc9946a >2013-12-09 14:44:55,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2fc9946a >2013-12-09 14:44:55,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c85efbe >2013-12-09 14:44:55,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c85efbe >2013-12-09 14:45:00,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30586469 >2013-12-09 14:45:00,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 30586469 >2013-12-09 14:45:00,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b9bf7cf >2013-12-09 14:45:01,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b9bf7cf >2013-12-09 14:45:06,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61c17ebb >2013-12-09 14:45:06,587 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-2) No up server in cluster >2013-12-09 14:45:06,588 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-2) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:45:06,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59e4c5f7 >2013-12-09 14:45:06,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 61c17ebb >2013-12-09 14:45:06,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1429477a >2013-12-09 14:45:06,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterTasksListVDSCommand, return: [], log id: 59e4c5f7 >2013-12-09 14:45:06,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1429477a >2013-12-09 14:45:11,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 117be7ff >2013-12-09 14:45:12,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 117be7ff >2013-12-09 14:45:12,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a2d3197 >2013-12-09 14:45:12,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a2d3197 >2013-12-09 14:45:17,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ffed9fe >2013-12-09 14:45:18,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ffed9fe >2013-12-09 14:45:18,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63802361 >2013-12-09 14:45:18,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63802361 >2013-12-09 14:45:23,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e240d52 >2013-12-09 14:45:24,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7e240d52 >2013-12-09 14:45:24,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32b6b25e >2013-12-09 14:45:24,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32b6b25e >2013-12-09 14:45:29,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4add35f0 >2013-12-09 14:45:29,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4add35f0 >2013-12-09 14:45:29,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d1a8f46 >2013-12-09 14:45:30,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d1a8f46 >2013-12-09 14:45:35,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37ea849 >2013-12-09 14:45:35,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 37ea849 >2013-12-09 14:45:35,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48c1fcce >2013-12-09 14:45:35,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48c1fcce >2013-12-09 14:45:40,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 709b9776 >2013-12-09 14:45:41,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 709b9776 >2013-12-09 14:45:41,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18035871 >2013-12-09 14:45:41,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18035871 >2013-12-09 14:45:46,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59a03ef7 >2013-12-09 14:45:47,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59a03ef7 >2013-12-09 14:45:47,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71309f28 >2013-12-09 14:45:47,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71309f28 >2013-12-09 14:45:52,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14e9b850 >2013-12-09 14:45:52,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 14e9b850 >2013-12-09 14:45:52,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 637b2f76 >2013-12-09 14:45:53,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 637b2f76 >2013-12-09 14:45:58,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ee1489b >2013-12-09 14:45:58,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5ee1489b >2013-12-09 14:45:58,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17752853 >2013-12-09 14:45:58,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17752853 >2013-12-09 14:46:03,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75ef1ba5 >2013-12-09 14:46:04,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 75ef1ba5 >2013-12-09 14:46:04,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c494ea7 >2013-12-09 14:46:04,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c494ea7 >2013-12-09 14:46:06,843 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-18) No up server in cluster >2013-12-09 14:46:06,843 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-18) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:46:06,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4aeb1a0d >2013-12-09 14:46:07,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4aeb1a0d >2013-12-09 14:46:09,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ce548b9 >2013-12-09 14:46:10,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5ce548b9 >2013-12-09 14:46:10,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7271f625 >2013-12-09 14:46:10,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7271f625 >2013-12-09 14:46:15,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7512ac38 >2013-12-09 14:46:15,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7512ac38 >2013-12-09 14:46:15,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 189792b5 >2013-12-09 14:46:16,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 189792b5 >2013-12-09 14:46:21,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2fe26d4a >2013-12-09 14:46:21,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2fe26d4a >2013-12-09 14:46:21,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c3a9ff4 >2013-12-09 14:46:21,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c3a9ff4 >2013-12-09 14:46:26,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71d285bd >2013-12-09 14:46:27,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 71d285bd >2013-12-09 14:46:27,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a5d6621 >2013-12-09 14:46:27,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a5d6621 >2013-12-09 14:46:32,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13f1d1dc >2013-12-09 14:46:33,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 13f1d1dc >2013-12-09 14:46:33,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e97eec7 >2013-12-09 14:46:33,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e97eec7 >2013-12-09 14:46:38,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 782a584 >2013-12-09 14:46:39,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 782a584 >2013-12-09 14:46:39,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a477344 >2013-12-09 14:46:39,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a477344 >2013-12-09 14:46:44,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73fca990 >2013-12-09 14:46:44,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 73fca990 >2013-12-09 14:46:44,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 524ec593 >2013-12-09 14:46:45,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 524ec593 >2013-12-09 14:46:50,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 232ae23f >2013-12-09 14:46:50,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 232ae23f >2013-12-09 14:46:50,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19a9f76a >2013-12-09 14:46:50,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19a9f76a >2013-12-09 14:46:55,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 345cc569 >2013-12-09 14:46:56,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 345cc569 >2013-12-09 14:46:56,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a325cbc >2013-12-09 14:46:56,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a325cbc >2013-12-09 14:47:01,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c7f5540 >2013-12-09 14:47:02,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c7f5540 >2013-12-09 14:47:02,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3168bc3 >2013-12-09 14:47:02,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3168bc3 >2013-12-09 14:47:07,113 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-100) No up server in cluster >2013-12-09 14:47:07,113 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-100) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:47:07,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a1c0df8 >2013-12-09 14:47:07,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 96352e8 >2013-12-09 14:47:07,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6a1c0df8 >2013-12-09 14:47:07,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 96352e8 >2013-12-09 14:47:07,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e203144 >2013-12-09 14:47:08,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e203144 >2013-12-09 14:47:13,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46178fe7 >2013-12-09 14:47:13,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 46178fe7 >2013-12-09 14:47:13,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37378170 >2013-12-09 14:47:13,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37378170 >2013-12-09 14:47:18,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 603576cf >2013-12-09 14:47:19,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 603576cf >2013-12-09 14:47:19,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ca8a66f >2013-12-09 14:47:19,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ca8a66f >2013-12-09 14:47:24,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5df64354 >2013-12-09 14:47:25,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5df64354 >2013-12-09 14:47:25,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53450e66 >2013-12-09 14:47:25,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53450e66 >2013-12-09 14:47:30,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28f7326e >2013-12-09 14:47:31,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 28f7326e >2013-12-09 14:47:31,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 776ebd0a >2013-12-09 14:47:31,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 776ebd0a >2013-12-09 14:47:36,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fc957e9 >2013-12-09 14:47:36,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7fc957e9 >2013-12-09 14:47:36,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ca40314 >2013-12-09 14:47:37,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ca40314 >2013-12-09 14:47:42,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17bb1b41 >2013-12-09 14:47:42,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 17bb1b41 >2013-12-09 14:47:42,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39e6d8b7 >2013-12-09 14:47:42,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39e6d8b7 >2013-12-09 14:47:47,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7655e293 >2013-12-09 14:47:48,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7655e293 >2013-12-09 14:47:48,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5926ece0 >2013-12-09 14:47:48,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5926ece0 >2013-12-09 14:47:53,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 293117ab >2013-12-09 14:47:54,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 293117ab >2013-12-09 14:47:54,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 752f36b8 >2013-12-09 14:47:54,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 752f36b8 >2013-12-09 14:47:59,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d0a843 >2013-12-09 14:47:59,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6d0a843 >2013-12-09 14:47:59,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45ae6027 >2013-12-09 14:48:00,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45ae6027 >2013-12-09 14:48:05,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ba04121 >2013-12-09 14:48:05,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3ba04121 >2013-12-09 14:48:05,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38177ece >2013-12-09 14:48:05,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38177ece >2013-12-09 14:48:07,392 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-12) No up server in cluster >2013-12-09 14:48:07,392 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-12) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:48:07,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e19916e >2013-12-09 14:48:07,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2e19916e >2013-12-09 14:48:10,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17f9d501 >2013-12-09 14:48:11,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 17f9d501 >2013-12-09 14:48:11,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a063a4b >2013-12-09 14:48:11,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a063a4b >2013-12-09 14:48:16,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f7d9793 >2013-12-09 14:48:17,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f7d9793 >2013-12-09 14:48:17,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4dc5de31 >2013-12-09 14:48:17,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4dc5de31 >2013-12-09 14:48:22,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c0dfe73 >2013-12-09 14:48:23,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5c0dfe73 >2013-12-09 14:48:23,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d4edca9 >2013-12-09 14:48:23,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d4edca9 >2013-12-09 14:48:28,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a66216e >2013-12-09 14:48:28,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7a66216e >2013-12-09 14:48:28,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 101e9573 >2013-12-09 14:48:29,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 101e9573 >2013-12-09 14:48:34,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 223897a9 >2013-12-09 14:48:34,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 223897a9 >2013-12-09 14:48:34,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c4da2f1 >2013-12-09 14:48:34,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c4da2f1 >2013-12-09 14:48:39,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6bc62479 >2013-12-09 14:48:40,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6bc62479 >2013-12-09 14:48:40,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46b2bcc >2013-12-09 14:48:40,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46b2bcc >2013-12-09 14:48:45,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17d1d007 >2013-12-09 14:48:46,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 17d1d007 >2013-12-09 14:48:46,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d1b4321 >2013-12-09 14:48:46,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d1b4321 >2013-12-09 14:48:51,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e8521da >2013-12-09 14:48:52,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e8521da >2013-12-09 14:48:52,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f87fa55 >2013-12-09 14:48:52,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f87fa55 >2013-12-09 14:48:57,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32567985 >2013-12-09 14:48:57,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 32567985 >2013-12-09 14:48:57,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79318b13 >2013-12-09 14:48:58,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79318b13 >2013-12-09 14:49:03,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75fc692c >2013-12-09 14:49:03,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 75fc692c >2013-12-09 14:49:03,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31082b61 >2013-12-09 14:49:03,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31082b61 >2013-12-09 14:49:07,680 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-63) No up server in cluster >2013-12-09 14:49:07,680 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-63) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:49:07,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4dbb1a46 >2013-12-09 14:49:07,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4dbb1a46 >2013-12-09 14:49:08,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 701adcf0 >2013-12-09 14:49:09,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 701adcf0 >2013-12-09 14:49:09,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2610d3c7 >2013-12-09 14:49:09,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2610d3c7 >2013-12-09 14:49:14,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6680ff38 >2013-12-09 14:49:15,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6680ff38 >2013-12-09 14:49:15,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13ec433c >2013-12-09 14:49:15,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13ec433c >2013-12-09 14:49:20,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c8861bd >2013-12-09 14:49:20,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c8861bd >2013-12-09 14:49:20,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a85bad8 >2013-12-09 14:49:21,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a85bad8 >2013-12-09 14:49:26,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68c1ae7a >2013-12-09 14:49:26,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 68c1ae7a >2013-12-09 14:49:26,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3440e5b0 >2013-12-09 14:49:26,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3440e5b0 >2013-12-09 14:49:31,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7250d459 >2013-12-09 14:49:32,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7250d459 >2013-12-09 14:49:32,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7dc8abcc >2013-12-09 14:49:32,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7dc8abcc >2013-12-09 14:49:37,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36d0fff1 >2013-12-09 14:49:38,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 36d0fff1 >2013-12-09 14:49:38,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e64d98b >2013-12-09 14:49:38,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e64d98b >2013-12-09 14:49:43,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c2f5b25 >2013-12-09 14:49:43,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: c2f5b25 >2013-12-09 14:49:43,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76df85e2 >2013-12-09 14:49:44,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76df85e2 >2013-12-09 14:49:49,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f5047b8 >2013-12-09 14:49:49,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f5047b8 >2013-12-09 14:49:49,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 225db578 >2013-12-09 14:49:50,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 225db578 >2013-12-09 14:49:55,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b964810 >2013-12-09 14:49:55,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3b964810 >2013-12-09 14:49:55,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1745fe5c >2013-12-09 14:49:55,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1745fe5c >2013-12-09 14:50:00,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 375d6ba >2013-12-09 14:50:01,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 375d6ba >2013-12-09 14:50:01,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a307aab >2013-12-09 14:50:01,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a307aab >2013-12-09 14:50:06,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ba3a0 >2013-12-09 14:50:07,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6ba3a0 >2013-12-09 14:50:07,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d3532c >2013-12-09 14:50:07,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d3532c >2013-12-09 14:50:07,963 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-90) No up server in cluster >2013-12-09 14:50:07,963 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-90) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:50:07,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f5f374f >2013-12-09 14:50:08,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1f5f374f >2013-12-09 14:50:12,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28f6254e >2013-12-09 14:50:12,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 28f6254e >2013-12-09 14:50:12,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54ac46d3 >2013-12-09 14:50:13,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54ac46d3 >2013-12-09 14:50:18,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ddfca33 >2013-12-09 14:50:18,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4ddfca33 >2013-12-09 14:50:18,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a64e93f >2013-12-09 14:50:19,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a64e93f >2013-12-09 14:50:24,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6dfe10ed >2013-12-09 14:50:24,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6dfe10ed >2013-12-09 14:50:24,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3633fb49 >2013-12-09 14:50:24,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3633fb49 >2013-12-09 14:50:29,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1920f232 >2013-12-09 14:50:30,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1920f232 >2013-12-09 14:50:30,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d8e0203 >2013-12-09 14:50:30,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d8e0203 >2013-12-09 14:50:35,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c3fcbe0 >2013-12-09 14:50:36,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c3fcbe0 >2013-12-09 14:50:36,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3805f87d >2013-12-09 14:50:36,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3805f87d >2013-12-09 14:50:41,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67f19e92 >2013-12-09 14:50:41,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 67f19e92 >2013-12-09 14:50:41,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ed6cc67 >2013-12-09 14:50:42,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ed6cc67 >2013-12-09 14:50:47,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48a8aa51 >2013-12-09 14:50:47,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 48a8aa51 >2013-12-09 14:50:47,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4326740 >2013-12-09 14:50:47,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4326740 >2013-12-09 14:50:52,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2de570e8 >2013-12-09 14:50:53,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2de570e8 >2013-12-09 14:50:53,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b4cb443 >2013-12-09 14:50:53,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b4cb443 >2013-12-09 14:50:58,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19c88a2c >2013-12-09 14:50:59,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 19c88a2c >2013-12-09 14:50:59,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32cb79ed >2013-12-09 14:50:59,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32cb79ed >2013-12-09 14:51:04,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5cca72c6 >2013-12-09 14:51:04,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5cca72c6 >2013-12-09 14:51:04,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a42bac3 >2013-12-09 14:51:05,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a42bac3 >2013-12-09 14:51:08,237 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-37) No up server in cluster >2013-12-09 14:51:08,237 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-37) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:51:08,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e757653 >2013-12-09 14:51:08,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3e757653 >2013-12-09 14:51:10,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23443cfe >2013-12-09 14:51:10,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 23443cfe >2013-12-09 14:51:10,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7228f1b7 >2013-12-09 14:51:10,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7228f1b7 >2013-12-09 14:51:15,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d89834f >2013-12-09 14:51:16,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2d89834f >2013-12-09 14:51:16,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a95ec8e >2013-12-09 14:51:16,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a95ec8e >2013-12-09 14:51:21,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c3b3557 >2013-12-09 14:51:22,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3c3b3557 >2013-12-09 14:51:22,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5fd09e2b >2013-12-09 14:51:22,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fd09e2b >2013-12-09 14:51:27,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b76d86a >2013-12-09 14:51:28,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1b76d86a >2013-12-09 14:51:28,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1065255f >2013-12-09 14:51:28,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1065255f >2013-12-09 14:51:33,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 521a1a55 >2013-12-09 14:51:33,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 521a1a55 >2013-12-09 14:51:33,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c1f591b >2013-12-09 14:51:34,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c1f591b >2013-12-09 14:51:39,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 205d84ab >2013-12-09 14:51:39,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 205d84ab >2013-12-09 14:51:39,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46dd39e7 >2013-12-09 14:51:39,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46dd39e7 >2013-12-09 14:51:44,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6702f6c6 >2013-12-09 14:51:45,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6702f6c6 >2013-12-09 14:51:45,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8e0123d >2013-12-09 14:51:45,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8e0123d >2013-12-09 14:51:50,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e23ea2f >2013-12-09 14:51:51,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e23ea2f >2013-12-09 14:51:51,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17903109 >2013-12-09 14:51:51,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17903109 >2013-12-09 14:51:56,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63db381b >2013-12-09 14:51:56,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 63db381b >2013-12-09 14:51:56,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51720e83 >2013-12-09 14:51:57,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51720e83 >2013-12-09 14:52:02,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 101a299d >2013-12-09 14:52:02,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 101a299d >2013-12-09 14:52:02,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7325ecf8 >2013-12-09 14:52:02,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7325ecf8 >2013-12-09 14:52:07,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d484e47 >2013-12-09 14:52:08,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d484e47 >2013-12-09 14:52:08,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b8e68fb >2013-12-09 14:52:08,526 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-28) No up server in cluster >2013-12-09 14:52:08,526 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-28) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:52:08,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3fd23342 >2013-12-09 14:52:08,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b8e68fb >2013-12-09 14:52:08,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3fd23342 >2013-12-09 14:52:13,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 537c3f28 >2013-12-09 14:52:14,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 537c3f28 >2013-12-09 14:52:14,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b4af28c >2013-12-09 14:52:14,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b4af28c >2013-12-09 14:52:19,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a93ed5 >2013-12-09 14:52:19,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4a93ed5 >2013-12-09 14:52:19,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53b28b7b >2013-12-09 14:52:20,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53b28b7b >2013-12-09 14:52:25,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62f16ed4 >2013-12-09 14:52:25,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 62f16ed4 >2013-12-09 14:52:25,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5df2ce63 >2013-12-09 14:52:25,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5df2ce63 >2013-12-09 14:52:30,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31bffc80 >2013-12-09 14:52:31,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 31bffc80 >2013-12-09 14:52:31,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1cfcc214 >2013-12-09 14:52:31,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1cfcc214 >2013-12-09 14:52:36,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2dc5150 >2013-12-09 14:52:37,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2dc5150 >2013-12-09 14:52:37,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fe5c7b5 >2013-12-09 14:52:37,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fe5c7b5 >2013-12-09 14:52:42,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1dd1a75d >2013-12-09 14:52:43,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1dd1a75d >2013-12-09 14:52:43,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fb34e33 >2013-12-09 14:52:43,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2fb34e33 >2013-12-09 14:52:48,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10a8afea >2013-12-09 14:52:48,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 10a8afea >2013-12-09 14:52:48,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5278769f >2013-12-09 14:52:49,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5278769f >2013-12-09 14:52:54,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 301f0d43 >2013-12-09 14:52:54,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 301f0d43 >2013-12-09 14:52:54,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 467290e2 >2013-12-09 14:52:54,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 467290e2 >2013-12-09 14:52:59,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10a4d4b3 >2013-12-09 14:53:00,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 10a4d4b3 >2013-12-09 14:53:00,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c215755 >2013-12-09 14:53:00,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c215755 >2013-12-09 14:53:05,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1982b786 >2013-12-09 14:53:06,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1982b786 >2013-12-09 14:53:06,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2adf8243 >2013-12-09 14:53:06,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2adf8243 >2013-12-09 14:53:08,770 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-38) No up server in cluster >2013-12-09 14:53:08,770 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-38) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:53:08,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4aedecd6 >2013-12-09 14:53:09,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4aedecd6 >2013-12-09 14:53:11,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1511ad9d >2013-12-09 14:53:11,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1511ad9d >2013-12-09 14:53:11,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 644d1afc >2013-12-09 14:53:12,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 644d1afc >2013-12-09 14:53:17,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7be0a556 >2013-12-09 14:53:17,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7be0a556 >2013-12-09 14:53:17,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e08a892 >2013-12-09 14:53:17,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e08a892 >2013-12-09 14:53:23,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6544467c >2013-12-09 14:53:23,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6544467c >2013-12-09 14:53:23,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30ba5fb5 >2013-12-09 14:53:23,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30ba5fb5 >2013-12-09 14:53:28,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61c10c95 >2013-12-09 14:53:29,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 61c10c95 >2013-12-09 14:53:29,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15282b11 >2013-12-09 14:53:29,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15282b11 >2013-12-09 14:53:34,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32a302c2 >2013-12-09 14:53:35,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 32a302c2 >2013-12-09 14:53:35,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 640e8f4d >2013-12-09 14:53:35,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 640e8f4d >2013-12-09 14:53:40,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d404f1b >2013-12-09 14:53:40,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2d404f1b >2013-12-09 14:53:40,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7da12ac1 >2013-12-09 14:53:41,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7da12ac1 >2013-12-09 14:53:46,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1cae2e94 >2013-12-09 14:53:46,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1cae2e94 >2013-12-09 14:53:46,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12704ee4 >2013-12-09 14:53:46,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12704ee4 >2013-12-09 14:53:51,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d8a7512 >2013-12-09 14:53:52,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6d8a7512 >2013-12-09 14:53:52,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60649455 >2013-12-09 14:53:52,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60649455 >2013-12-09 14:53:57,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a512ecd >2013-12-09 14:53:58,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a512ecd >2013-12-09 14:53:58,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 581bb1c9 >2013-12-09 14:53:58,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 581bb1c9 >2013-12-09 14:54:03,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 633b0b40 >2013-12-09 14:54:03,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 633b0b40 >2013-12-09 14:54:03,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53c9b398 >2013-12-09 14:54:04,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53c9b398 >2013-12-09 14:54:09,046 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-27) No up server in cluster >2013-12-09 14:54:09,047 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-27) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:54:09,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 785df1eb >2013-12-09 14:54:09,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24a53104 >2013-12-09 14:54:09,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterTasksListVDSCommand, return: [], log id: 785df1eb >2013-12-09 14:54:09,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 24a53104 >2013-12-09 14:54:09,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3cb0881c >2013-12-09 14:54:09,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3cb0881c >2013-12-09 14:54:15,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45cf2435 >2013-12-09 14:54:15,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 45cf2435 >2013-12-09 14:54:15,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5212bf59 >2013-12-09 14:54:15,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5212bf59 >2013-12-09 14:54:20,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b2dbc26 >2013-12-09 14:54:21,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b2dbc26 >2013-12-09 14:54:21,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e660866 >2013-12-09 14:54:21,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e660866 >2013-12-09 14:54:26,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54fb3ab6 >2013-12-09 14:54:27,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 54fb3ab6 >2013-12-09 14:54:27,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 281f612 >2013-12-09 14:54:27,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 281f612 >2013-12-09 14:54:32,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33b88021 >2013-12-09 14:54:32,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 33b88021 >2013-12-09 14:54:32,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46a3db31 >2013-12-09 14:54:33,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46a3db31 >2013-12-09 14:54:38,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b143327 >2013-12-09 14:54:38,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b143327 >2013-12-09 14:54:38,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 752b7913 >2013-12-09 14:54:38,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 752b7913 >2013-12-09 14:54:43,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f778fb5 >2013-12-09 14:54:44,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f778fb5 >2013-12-09 14:54:44,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 756f7e71 >2013-12-09 14:54:44,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 756f7e71 >2013-12-09 14:54:49,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1809660 >2013-12-09 14:54:50,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1809660 >2013-12-09 14:54:50,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c1e787c >2013-12-09 14:54:50,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c1e787c >2013-12-09 14:54:55,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e5b065c >2013-12-09 14:54:55,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7e5b065c >2013-12-09 14:54:55,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a84e275 >2013-12-09 14:54:56,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a84e275 >2013-12-09 14:55:01,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f9372ee >2013-12-09 14:55:01,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: f9372ee >2013-12-09 14:55:01,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e2c53e0 >2013-12-09 14:55:01,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e2c53e0 >2013-12-09 14:55:06,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 684ee9b2 >2013-12-09 14:55:07,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 684ee9b2 >2013-12-09 14:55:07,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70ea186a >2013-12-09 14:55:07,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70ea186a >2013-12-09 14:55:09,318 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-72) No up server in cluster >2013-12-09 14:55:09,318 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-72) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:55:09,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b0e22aa >2013-12-09 14:55:09,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterTasksListVDSCommand, return: [], log id: b0e22aa >2013-12-09 14:55:12,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53cc5b67 >2013-12-09 14:55:13,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 53cc5b67 >2013-12-09 14:55:13,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4bfcf0ea >2013-12-09 14:55:13,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4bfcf0ea >2013-12-09 14:55:18,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e09422f >2013-12-09 14:55:19,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3e09422f >2013-12-09 14:55:19,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4857463a >2013-12-09 14:55:19,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4857463a >2013-12-09 14:55:24,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3acdbab3 >2013-12-09 14:55:24,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3acdbab3 >2013-12-09 14:55:24,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d6e90fa >2013-12-09 14:55:25,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d6e90fa >2013-12-09 14:55:30,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16f9cc7f >2013-12-09 14:55:30,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 16f9cc7f >2013-12-09 14:55:30,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 702a2b24 >2013-12-09 14:55:30,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 702a2b24 >2013-12-09 14:55:35,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20af674 >2013-12-09 14:55:36,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 20af674 >2013-12-09 14:55:36,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3db75019 >2013-12-09 14:55:36,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3db75019 >2013-12-09 14:55:41,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5931eef0 >2013-12-09 14:55:42,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5931eef0 >2013-12-09 14:55:42,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7271a905 >2013-12-09 14:55:42,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7271a905 >2013-12-09 14:55:47,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8c88c21 >2013-12-09 14:55:47,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 8c88c21 >2013-12-09 14:55:47,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f837b9b >2013-12-09 14:55:48,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f837b9b >2013-12-09 14:55:53,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76bd9a78 >2013-12-09 14:55:53,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 76bd9a78 >2013-12-09 14:55:53,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c2d54c2 >2013-12-09 14:55:54,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c2d54c2 >2013-12-09 14:55:59,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 186b7901 >2013-12-09 14:55:59,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 186b7901 >2013-12-09 14:55:59,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18ae9e51 >2013-12-09 14:55:59,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18ae9e51 >2013-12-09 14:56:04,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1edd5545 >2013-12-09 14:56:05,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1edd5545 >2013-12-09 14:56:05,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: df50ba6 >2013-12-09 14:56:05,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: df50ba6 >2013-12-09 14:56:09,587 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-45) No up server in cluster >2013-12-09 14:56:09,587 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-45) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:56:09,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1fa29641 >2013-12-09 14:56:09,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1fa29641 >2013-12-09 14:56:10,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40aac8c6 >2013-12-09 14:56:11,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 40aac8c6 >2013-12-09 14:56:11,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12e2c01 >2013-12-09 14:56:11,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12e2c01 >2013-12-09 14:56:16,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 720e1fe0 >2013-12-09 14:56:16,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 720e1fe0 >2013-12-09 14:56:16,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7cda5df0 >2013-12-09 14:56:17,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7cda5df0 >2013-12-09 14:56:22,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f3870d4 >2013-12-09 14:56:22,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f3870d4 >2013-12-09 14:56:22,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11823cb7 >2013-12-09 14:56:22,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11823cb7 >2013-12-09 14:56:27,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c6757cb >2013-12-09 14:56:28,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c6757cb >2013-12-09 14:56:28,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d01c949 >2013-12-09 14:56:28,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d01c949 >2013-12-09 14:56:33,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25fdff70 >2013-12-09 14:56:34,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 25fdff70 >2013-12-09 14:56:34,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e1f88d5 >2013-12-09 14:56:34,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e1f88d5 >2013-12-09 14:56:39,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b37b491 >2013-12-09 14:56:39,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b37b491 >2013-12-09 14:56:39,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3469033c >2013-12-09 14:56:40,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3469033c >2013-12-09 14:56:45,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73166e37 >2013-12-09 14:56:45,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 73166e37 >2013-12-09 14:56:45,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2785f9 >2013-12-09 14:56:45,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2785f9 >2013-12-09 14:56:51,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f815e9b >2013-12-09 14:56:51,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7f815e9b >2013-12-09 14:56:51,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2aac82fa >2013-12-09 14:56:51,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2aac82fa >2013-12-09 14:56:56,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 550eb20c >2013-12-09 14:56:57,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 550eb20c >2013-12-09 14:56:57,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 473c7084 >2013-12-09 14:56:57,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 473c7084 >2013-12-09 14:57:02,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41db70b2 >2013-12-09 14:57:03,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 41db70b2 >2013-12-09 14:57:03,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10271a00 >2013-12-09 14:57:03,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10271a00 >2013-12-09 14:57:08,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15e9ca45 >2013-12-09 14:57:08,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 15e9ca45 >2013-12-09 14:57:08,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a2a5914 >2013-12-09 14:57:09,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a2a5914 >2013-12-09 14:57:09,878 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-4) No up server in cluster >2013-12-09 14:57:09,878 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-4) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:57:09,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1bba7a08 >2013-12-09 14:57:10,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1bba7a08 >2013-12-09 14:57:14,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ecf5543 >2013-12-09 14:57:14,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2ecf5543 >2013-12-09 14:57:14,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 415e6da3 >2013-12-09 14:57:14,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 415e6da3 >2013-12-09 14:57:19,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d598115 >2013-12-09 14:57:20,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d598115 >2013-12-09 14:57:20,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7bbfa10 >2013-12-09 14:57:20,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7bbfa10 >2013-12-09 14:57:25,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 499e8aa2 >2013-12-09 14:57:26,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 499e8aa2 >2013-12-09 14:57:26,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 171f538 >2013-12-09 14:57:26,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 171f538 >2013-12-09 14:57:31,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 612bc4b6 >2013-12-09 14:57:32,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 612bc4b6 >2013-12-09 14:57:32,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62a836f7 >2013-12-09 14:57:32,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62a836f7 >2013-12-09 14:57:37,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3fcb0e9d >2013-12-09 14:57:37,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3fcb0e9d >2013-12-09 14:57:37,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f825f1e >2013-12-09 14:57:38,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f825f1e >2013-12-09 14:57:43,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50eb363c >2013-12-09 14:57:43,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 50eb363c >2013-12-09 14:57:43,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 386e9770 >2013-12-09 14:57:43,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 386e9770 >2013-12-09 14:57:48,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f71a665 >2013-12-09 14:57:49,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f71a665 >2013-12-09 14:57:49,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73216a7a >2013-12-09 14:57:49,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73216a7a >2013-12-09 14:57:54,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4941845e >2013-12-09 14:57:55,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4941845e >2013-12-09 14:57:55,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56d60ec0 >2013-12-09 14:57:55,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56d60ec0 >2013-12-09 14:58:00,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b831f9c >2013-12-09 14:58:00,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b831f9c >2013-12-09 14:58:00,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a7b2f4f >2013-12-09 14:58:01,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a7b2f4f >2013-12-09 14:58:06,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38625555 >2013-12-09 14:58:06,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 38625555 >2013-12-09 14:58:06,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6110a9c8 >2013-12-09 14:58:07,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6110a9c8 >2013-12-09 14:58:10,159 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-19) No up server in cluster >2013-12-09 14:58:10,159 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-19) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:58:10,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37130905 >2013-12-09 14:58:10,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterTasksListVDSCommand, return: [], log id: 37130905 >2013-12-09 14:58:12,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d16eb29 >2013-12-09 14:58:12,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d16eb29 >2013-12-09 14:58:12,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25c0f787 >2013-12-09 14:58:12,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25c0f787 >2013-12-09 14:58:17,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3dabf331 >2013-12-09 14:58:18,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3dabf331 >2013-12-09 14:58:18,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b18026 >2013-12-09 14:58:18,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b18026 >2013-12-09 14:58:23,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 676aedb5 >2013-12-09 14:58:24,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 676aedb5 >2013-12-09 14:58:24,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35e17883 >2013-12-09 14:58:24,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35e17883 >2013-12-09 14:58:29,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21303682 >2013-12-09 14:58:29,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 21303682 >2013-12-09 14:58:29,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34a7c6aa >2013-12-09 14:58:30,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34a7c6aa >2013-12-09 14:58:35,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 927431c >2013-12-09 14:58:35,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 927431c >2013-12-09 14:58:35,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6859da6c >2013-12-09 14:58:35,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6859da6c >2013-12-09 14:58:40,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c30c347 >2013-12-09 14:58:41,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2c30c347 >2013-12-09 14:58:41,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5181cddd >2013-12-09 14:58:41,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5181cddd >2013-12-09 14:58:46,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: bbaab9c >2013-12-09 14:58:47,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: bbaab9c >2013-12-09 14:58:47,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4692cefb >2013-12-09 14:58:47,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4692cefb >2013-12-09 14:58:52,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6421d1c8 >2013-12-09 14:58:52,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6421d1c8 >2013-12-09 14:58:52,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f68f28c >2013-12-09 14:58:53,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f68f28c >2013-12-09 14:58:58,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c23f0c6 >2013-12-09 14:58:58,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: c23f0c6 >2013-12-09 14:58:58,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52a845a1 >2013-12-09 14:58:58,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52a845a1 >2013-12-09 14:59:03,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b2ebcac >2013-12-09 14:59:04,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b2ebcac >2013-12-09 14:59:04,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1fa87dac >2013-12-09 14:59:04,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1fa87dac >2013-12-09 14:59:09,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59d0487 >2013-12-09 14:59:10,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59d0487 >2013-12-09 14:59:10,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5107a42e >2013-12-09 14:59:10,427 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-25) No up server in cluster >2013-12-09 14:59:10,427 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-25) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 14:59:10,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b591a03 >2013-12-09 14:59:10,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5107a42e >2013-12-09 14:59:10,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3b591a03 >2013-12-09 14:59:15,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3755aa5c >2013-12-09 14:59:16,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3755aa5c >2013-12-09 14:59:16,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 161639ac >2013-12-09 14:59:16,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 161639ac >2013-12-09 14:59:21,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a67450d >2013-12-09 14:59:21,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6a67450d >2013-12-09 14:59:21,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48ec52ff >2013-12-09 14:59:22,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48ec52ff >2013-12-09 14:59:27,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 107e799c >2013-12-09 14:59:27,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 107e799c >2013-12-09 14:59:27,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b4bbb94 >2013-12-09 14:59:27,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b4bbb94 >2013-12-09 14:59:32,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8f839b >2013-12-09 14:59:33,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 8f839b >2013-12-09 14:59:33,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72bb9f1c >2013-12-09 14:59:33,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72bb9f1c >2013-12-09 14:59:38,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a4c2981 >2013-12-09 14:59:38,752 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-53) Attempting to update VMs/Templates Ovf. >2013-12-09 14:59:39,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4a4c2981 >2013-12-09 14:59:39,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e58852 >2013-12-09 14:59:39,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e58852 >2013-12-09 14:59:40,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-48) START, GlusterHooksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f2536f5 >2013-12-09 14:59:40,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-49) START, GlusterHooksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f2536f5 >2013-12-09 14:59:40,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-48) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@208857f4, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@8270d008, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@eaf2eede, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@fcaf6497, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@d4e36318, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@40043cc8, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@94b67005], log id: 3f2536f5 >2013-12-09 14:59:40,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-4-thread-49) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@103b9f8d, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@5035da87, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@49938f8d, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@72890440, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@93580f2c, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@8dc03c3, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@a26642df], log id: 3f2536f5 >2013-12-09 14:59:44,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3394024f >2013-12-09 14:59:44,666 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-13) Start refreshing all users data >2013-12-09 14:59:44,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3394024f >2013-12-09 14:59:44,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3af1b94 >2013-12-09 14:59:45,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3af1b94 >2013-12-09 14:59:50,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a791caf >2013-12-09 14:59:50,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2a791caf >2013-12-09 14:59:50,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: baf61e8 >2013-12-09 14:59:51,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: baf61e8 >2013-12-09 14:59:56,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49ff9224 >2013-12-09 14:59:56,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 49ff9224 >2013-12-09 14:59:56,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 158020bc >2013-12-09 14:59:56,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 158020bc >2013-12-09 15:00:01,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 60da3755 >2013-12-09 15:00:02,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 60da3755 >2013-12-09 15:00:02,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21a5d326 >2013-12-09 15:00:02,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21a5d326 >2013-12-09 15:00:07,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ef5e78 >2013-12-09 15:00:08,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: ef5e78 >2013-12-09 15:00:08,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2948054 >2013-12-09 15:00:08,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2948054 >2013-12-09 15:00:10,696 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) No up server in cluster >2013-12-09 15:00:10,696 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:00:10,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48727bb5 >2013-12-09 15:00:10,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterTasksListVDSCommand, return: [], log id: 48727bb5 >2013-12-09 15:00:13,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 170a781f >2013-12-09 15:00:13,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 170a781f >2013-12-09 15:00:13,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9d98027 >2013-12-09 15:00:14,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9d98027 >2013-12-09 15:00:19,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66308e75 >2013-12-09 15:00:19,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 66308e75 >2013-12-09 15:00:19,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44cc348 >2013-12-09 15:00:19,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44cc348 >2013-12-09 15:00:24,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72dc9ac3 >2013-12-09 15:00:25,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 72dc9ac3 >2013-12-09 15:00:25,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 340ddf0b >2013-12-09 15:00:25,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 340ddf0b >2013-12-09 15:00:30,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b1b0fd >2013-12-09 15:00:31,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b1b0fd >2013-12-09 15:00:31,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f9cae7f >2013-12-09 15:00:31,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f9cae7f >2013-12-09 15:00:36,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c60f17d >2013-12-09 15:00:37,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6c60f17d >2013-12-09 15:00:37,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 514f96f5 >2013-12-09 15:00:37,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 514f96f5 >2013-12-09 15:00:42,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5427ce7f >2013-12-09 15:00:42,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5427ce7f >2013-12-09 15:00:42,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1037f002 >2013-12-09 15:00:43,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1037f002 >2013-12-09 15:00:48,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39ee3435 >2013-12-09 15:00:48,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 39ee3435 >2013-12-09 15:00:48,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 342788cc >2013-12-09 15:00:48,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 342788cc >2013-12-09 15:00:53,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f144de8 >2013-12-09 15:00:54,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f144de8 >2013-12-09 15:00:54,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30fbf6f7 >2013-12-09 15:00:54,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30fbf6f7 >2013-12-09 15:00:59,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52989dcd >2013-12-09 15:01:00,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 52989dcd >2013-12-09 15:01:00,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 339d7194 >2013-12-09 15:01:00,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 339d7194 >2013-12-09 15:01:05,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d4a20 >2013-12-09 15:01:05,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6d4a20 >2013-12-09 15:01:05,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a28a99 >2013-12-09 15:01:06,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a28a99 >2013-12-09 15:01:10,996 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-20) No up server in cluster >2013-12-09 15:01:10,996 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-20) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:01:11,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c932140 >2013-12-09 15:01:11,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b10947a >2013-12-09 15:01:11,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6c932140 >2013-12-09 15:01:11,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6b10947a >2013-12-09 15:01:11,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13e65f10 >2013-12-09 15:01:11,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13e65f10 >2013-12-09 15:01:16,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7eaf0496 >2013-12-09 15:01:17,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7eaf0496 >2013-12-09 15:01:17,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7737c3e1 >2013-12-09 15:01:17,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7737c3e1 >2013-12-09 15:01:22,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d3d9b79 >2013-12-09 15:01:23,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6d3d9b79 >2013-12-09 15:01:23,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1094e88b >2013-12-09 15:01:23,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1094e88b >2013-12-09 15:01:28,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39d0f7af >2013-12-09 15:01:29,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 39d0f7af >2013-12-09 15:01:29,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62df9796 >2013-12-09 15:01:29,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62df9796 >2013-12-09 15:01:34,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b4eaae1 >2013-12-09 15:01:34,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b4eaae1 >2013-12-09 15:01:34,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74c58cf0 >2013-12-09 15:01:35,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74c58cf0 >2013-12-09 15:01:40,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12a13847 >2013-12-09 15:01:40,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 12a13847 >2013-12-09 15:01:40,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f44cadd >2013-12-09 15:01:40,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f44cadd >2013-12-09 15:01:45,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6534cca5 >2013-12-09 15:01:46,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6534cca5 >2013-12-09 15:01:46,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f60e6ef >2013-12-09 15:01:46,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f60e6ef >2013-12-09 15:01:51,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 763642c8 >2013-12-09 15:01:52,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 763642c8 >2013-12-09 15:01:52,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15fb21bd >2013-12-09 15:01:52,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15fb21bd >2013-12-09 15:01:57,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53fd7c37 >2013-12-09 15:01:57,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 53fd7c37 >2013-12-09 15:01:57,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bec81a0 >2013-12-09 15:01:58,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bec81a0 >2013-12-09 15:02:03,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4efd0ee5 >2013-12-09 15:02:03,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4efd0ee5 >2013-12-09 15:02:03,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4df21472 >2013-12-09 15:02:03,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4df21472 >2013-12-09 15:02:08,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38a1ec88 >2013-12-09 15:02:09,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 38a1ec88 >2013-12-09 15:02:09,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 641dd14 >2013-12-09 15:02:09,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 641dd14 >2013-12-09 15:02:11,301 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-13) No up server in cluster >2013-12-09 15:02:11,301 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-13) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:02:11,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2163add8 >2013-12-09 15:02:11,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2163add8 >2013-12-09 15:02:14,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 326d4d0 >2013-12-09 15:02:15,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 326d4d0 >2013-12-09 15:02:15,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54c91fc5 >2013-12-09 15:02:15,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54c91fc5 >2013-12-09 15:02:20,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 523df45f >2013-12-09 15:02:21,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 523df45f >2013-12-09 15:02:21,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 372ef7e8 >2013-12-09 15:02:21,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 372ef7e8 >2013-12-09 15:02:26,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f47de07 >2013-12-09 15:02:26,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f47de07 >2013-12-09 15:02:26,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c34a31 >2013-12-09 15:02:27,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c34a31 >2013-12-09 15:02:32,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52a59e55 >2013-12-09 15:02:32,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 52a59e55 >2013-12-09 15:02:32,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30fdd3be >2013-12-09 15:02:32,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30fdd3be >2013-12-09 15:02:37,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11d727d6 >2013-12-09 15:02:38,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 11d727d6 >2013-12-09 15:02:38,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57f35e4a >2013-12-09 15:02:38,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57f35e4a >2013-12-09 15:02:43,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b2c7aa7 >2013-12-09 15:02:44,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5b2c7aa7 >2013-12-09 15:02:44,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d60f26d >2013-12-09 15:02:44,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d60f26d >2013-12-09 15:02:49,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3bd12d6d >2013-12-09 15:02:49,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3bd12d6d >2013-12-09 15:02:49,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f5d7c09 >2013-12-09 15:02:50,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f5d7c09 >2013-12-09 15:02:55,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4467f172 >2013-12-09 15:02:55,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4467f172 >2013-12-09 15:02:55,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e01b13c >2013-12-09 15:02:55,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e01b13c >2013-12-09 15:03:00,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 85f8f84 >2013-12-09 15:03:01,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 85f8f84 >2013-12-09 15:03:01,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 575fccd8 >2013-12-09 15:03:01,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 575fccd8 >2013-12-09 15:03:06,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 121664ae >2013-12-09 15:03:07,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 121664ae >2013-12-09 15:03:07,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 478a408a >2013-12-09 15:03:07,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 478a408a >2013-12-09 15:03:11,587 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-29) No up server in cluster >2013-12-09 15:03:11,587 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-29) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:03:11,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: eb92238 >2013-12-09 15:03:11,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterTasksListVDSCommand, return: [], log id: eb92238 >2013-12-09 15:03:12,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27e7377c >2013-12-09 15:03:13,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 27e7377c >2013-12-09 15:03:13,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50d362b >2013-12-09 15:03:13,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50d362b >2013-12-09 15:03:18,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d0c241e >2013-12-09 15:03:18,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d0c241e >2013-12-09 15:03:18,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e000b4d >2013-12-09 15:03:19,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e000b4d >2013-12-09 15:03:24,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 293529ed >2013-12-09 15:03:24,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 293529ed >2013-12-09 15:03:24,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 455c94ed >2013-12-09 15:03:24,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 455c94ed >2013-12-09 15:03:29,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31129687 >2013-12-09 15:03:30,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 31129687 >2013-12-09 15:03:30,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a4b8c03 >2013-12-09 15:03:30,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a4b8c03 >2013-12-09 15:03:35,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b18d156 >2013-12-09 15:03:36,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5b18d156 >2013-12-09 15:03:36,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33fa1c58 >2013-12-09 15:03:36,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33fa1c58 >2013-12-09 15:03:41,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27f3ebd1 >2013-12-09 15:03:41,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 27f3ebd1 >2013-12-09 15:03:41,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 324928f7 >2013-12-09 15:03:42,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 324928f7 >2013-12-09 15:03:47,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68b4431c >2013-12-09 15:03:47,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 68b4431c >2013-12-09 15:03:47,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3312604b >2013-12-09 15:03:47,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3312604b >2013-12-09 15:03:53,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ca04f0c >2013-12-09 15:03:53,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: ca04f0c >2013-12-09 15:03:53,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2705c798 >2013-12-09 15:03:53,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2705c798 >2013-12-09 15:03:58,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d58f8a5 >2013-12-09 15:03:59,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: d58f8a5 >2013-12-09 15:03:59,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f2bf6b8 >2013-12-09 15:03:59,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f2bf6b8 >2013-12-09 15:04:04,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ae20e15 >2013-12-09 15:04:05,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ae20e15 >2013-12-09 15:04:05,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3db42d05 >2013-12-09 15:04:05,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3db42d05 >2013-12-09 15:04:10,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45d751f0 >2013-12-09 15:04:10,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 45d751f0 >2013-12-09 15:04:10,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 353173ec >2013-12-09 15:04:11,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 353173ec >2013-12-09 15:04:11,860 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-16) No up server in cluster >2013-12-09 15:04:11,860 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-16) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:04:11,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b92bd20 >2013-12-09 15:04:12,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1b92bd20 >2013-12-09 15:04:16,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 589ad6fe >2013-12-09 15:04:16,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 589ad6fe >2013-12-09 15:04:16,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 218ce763 >2013-12-09 15:04:16,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 218ce763 >2013-12-09 15:04:21,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e5a9d66 >2013-12-09 15:04:22,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e5a9d66 >2013-12-09 15:04:22,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66e2ec88 >2013-12-09 15:04:22,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66e2ec88 >2013-12-09 15:04:27,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c01bbfe >2013-12-09 15:04:28,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7c01bbfe >2013-12-09 15:04:28,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e7c45d1 >2013-12-09 15:04:28,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e7c45d1 >2013-12-09 15:04:33,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e974510 >2013-12-09 15:04:34,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2e974510 >2013-12-09 15:04:34,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a605b66 >2013-12-09 15:04:34,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a605b66 >2013-12-09 15:04:39,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3079abf >2013-12-09 15:04:39,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3079abf >2013-12-09 15:04:39,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75e57b28 >2013-12-09 15:04:40,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75e57b28 >2013-12-09 15:04:45,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64e0a89c >2013-12-09 15:04:45,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 64e0a89c >2013-12-09 15:04:45,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 406f46e9 >2013-12-09 15:04:45,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 406f46e9 >2013-12-09 15:04:50,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63a5b0da >2013-12-09 15:04:51,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 63a5b0da >2013-12-09 15:04:51,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e6553a1 >2013-12-09 15:04:51,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e6553a1 >2013-12-09 15:04:56,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1435a6f4 >2013-12-09 15:04:57,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1435a6f4 >2013-12-09 15:04:57,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5df2ce06 >2013-12-09 15:04:57,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5df2ce06 >2013-12-09 15:05:02,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50a2a932 >2013-12-09 15:05:02,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 50a2a932 >2013-12-09 15:05:02,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38f83875 >2013-12-09 15:05:03,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38f83875 >2013-12-09 15:05:08,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ebbe76b >2013-12-09 15:05:08,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5ebbe76b >2013-12-09 15:05:08,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49a4f3a2 >2013-12-09 15:05:08,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49a4f3a2 >2013-12-09 15:05:12,159 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-22) No up server in cluster >2013-12-09 15:05:12,159 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-22) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:05:12,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4666be02 >2013-12-09 15:05:12,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4666be02 >2013-12-09 15:05:13,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d825466 >2013-12-09 15:05:14,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d825466 >2013-12-09 15:05:14,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ab46660 >2013-12-09 15:05:14,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ab46660 >2013-12-09 15:05:19,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 202110b6 >2013-12-09 15:05:20,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 202110b6 >2013-12-09 15:05:20,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c1b0d4 >2013-12-09 15:05:20,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c1b0d4 >2013-12-09 15:05:25,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8d8f831 >2013-12-09 15:05:25,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 8d8f831 >2013-12-09 15:05:25,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b53eb86 >2013-12-09 15:05:26,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b53eb86 >2013-12-09 15:05:31,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42efd091 >2013-12-09 15:05:31,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42efd091 >2013-12-09 15:05:31,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23d8b907 >2013-12-09 15:05:31,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23d8b907 >2013-12-09 15:05:37,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c9dd4bc >2013-12-09 15:05:37,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c9dd4bc >2013-12-09 15:05:37,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59fb5381 >2013-12-09 15:05:37,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59fb5381 >2013-12-09 15:05:42,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5980f37d >2013-12-09 15:05:43,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5980f37d >2013-12-09 15:05:43,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a53c331 >2013-12-09 15:05:43,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a53c331 >2013-12-09 15:05:48,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3524c761 >2013-12-09 15:05:49,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3524c761 >2013-12-09 15:05:49,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11fdc672 >2013-12-09 15:05:49,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11fdc672 >2013-12-09 15:05:54,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4357f831 >2013-12-09 15:05:54,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4357f831 >2013-12-09 15:05:54,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26ac7e74 >2013-12-09 15:05:55,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26ac7e74 >2013-12-09 15:06:00,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72599e90 >2013-12-09 15:06:00,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 72599e90 >2013-12-09 15:06:00,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a90c965 >2013-12-09 15:06:00,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a90c965 >2013-12-09 15:06:05,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66833fa >2013-12-09 15:06:06,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 66833fa >2013-12-09 15:06:06,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 164ca03e >2013-12-09 15:06:06,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 164ca03e >2013-12-09 15:06:11,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 722bad7b >2013-12-09 15:06:12,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 722bad7b >2013-12-09 15:06:12,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 405c0114 >2013-12-09 15:06:12,446 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-36) No up server in cluster >2013-12-09 15:06:12,447 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-36) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:06:12,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c22fc01 >2013-12-09 15:06:12,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 405c0114 >2013-12-09 15:06:12,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterTasksListVDSCommand, return: [], log id: c22fc01 >2013-12-09 15:06:17,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5910d5ff >2013-12-09 15:06:17,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5910d5ff >2013-12-09 15:06:17,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2766f849 >2013-12-09 15:06:18,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2766f849 >2013-12-09 15:06:23,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57a6e073 >2013-12-09 15:06:23,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 57a6e073 >2013-12-09 15:06:23,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61bdc178 >2013-12-09 15:06:24,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61bdc178 >2013-12-09 15:06:29,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 499734e0 >2013-12-09 15:06:29,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 499734e0 >2013-12-09 15:06:29,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66f066f9 >2013-12-09 15:06:29,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66f066f9 >2013-12-09 15:06:34,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 385b70e5 >2013-12-09 15:06:35,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 385b70e5 >2013-12-09 15:06:35,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ba5c2e3 >2013-12-09 15:06:35,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ba5c2e3 >2013-12-09 15:06:40,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5eff6b6f >2013-12-09 15:06:41,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5eff6b6f >2013-12-09 15:06:41,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35802704 >2013-12-09 15:06:41,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35802704 >2013-12-09 15:06:46,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 788c55fb >2013-12-09 15:06:46,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 788c55fb >2013-12-09 15:06:46,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2606b84a >2013-12-09 15:06:47,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2606b84a >2013-12-09 15:06:52,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51840178 >2013-12-09 15:06:52,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 51840178 >2013-12-09 15:06:52,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19cb7e55 >2013-12-09 15:06:52,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19cb7e55 >2013-12-09 15:06:57,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 585d2cfc >2013-12-09 15:06:58,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 585d2cfc >2013-12-09 15:06:58,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5917bb91 >2013-12-09 15:06:58,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5917bb91 >2013-12-09 15:07:03,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55f67cc5 >2013-12-09 15:07:04,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 55f67cc5 >2013-12-09 15:07:04,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a3e9f4 >2013-12-09 15:07:04,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a3e9f4 >2013-12-09 15:07:09,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6eb4f72 >2013-12-09 15:07:09,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6eb4f72 >2013-12-09 15:07:09,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b844edf >2013-12-09 15:07:10,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b844edf >2013-12-09 15:07:12,732 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-87) No up server in cluster >2013-12-09 15:07:12,732 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-87) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:07:12,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 694c833c >2013-12-09 15:07:13,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterTasksListVDSCommand, return: [], log id: 694c833c >2013-12-09 15:07:15,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6cc9e698 >2013-12-09 15:07:15,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6cc9e698 >2013-12-09 15:07:15,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2763d671 >2013-12-09 15:07:16,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2763d671 >2013-12-09 15:07:21,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 94c69d4 >2013-12-09 15:07:21,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 94c69d4 >2013-12-09 15:07:21,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37830868 >2013-12-09 15:07:21,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37830868 >2013-12-09 15:07:26,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d7d3890 >2013-12-09 15:07:27,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d7d3890 >2013-12-09 15:07:27,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ddc00c5 >2013-12-09 15:07:27,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ddc00c5 >2013-12-09 15:07:32,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 779fc4d7 >2013-12-09 15:07:33,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 779fc4d7 >2013-12-09 15:07:33,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75375626 >2013-12-09 15:07:33,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75375626 >2013-12-09 15:07:38,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 770edcb >2013-12-09 15:07:38,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 770edcb >2013-12-09 15:07:38,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f3e79f6 >2013-12-09 15:07:39,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f3e79f6 >2013-12-09 15:07:44,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7deb67b2 >2013-12-09 15:07:44,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7deb67b2 >2013-12-09 15:07:44,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3253ba80 >2013-12-09 15:07:44,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3253ba80 >2013-12-09 15:07:49,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17e20e14 >2013-12-09 15:07:50,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 17e20e14 >2013-12-09 15:07:50,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e594f8a >2013-12-09 15:07:50,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e594f8a >2013-12-09 15:07:55,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3dc51687 >2013-12-09 15:07:56,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3dc51687 >2013-12-09 15:07:56,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11da4425 >2013-12-09 15:07:56,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11da4425 >2013-12-09 15:08:01,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d63ce60 >2013-12-09 15:08:01,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d63ce60 >2013-12-09 15:08:01,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 152006ae >2013-12-09 15:08:02,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 152006ae >2013-12-09 15:08:07,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71117ff4 >2013-12-09 15:08:07,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 71117ff4 >2013-12-09 15:08:07,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16427392 >2013-12-09 15:08:07,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16427392 >2013-12-09 15:08:13,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 432131e0 >2013-12-09 15:08:13,016 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) No up server in cluster >2013-12-09 15:08:13,016 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:08:13,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21d153a6 >2013-12-09 15:08:13,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterTasksListVDSCommand, return: [], log id: 21d153a6 >2013-12-09 15:08:13,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 432131e0 >2013-12-09 15:08:13,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71c35b0a >2013-12-09 15:08:13,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71c35b0a >2013-12-09 15:08:18,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ef08f26 >2013-12-09 15:08:19,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7ef08f26 >2013-12-09 15:08:19,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4595f3ff >2013-12-09 15:08:19,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4595f3ff >2013-12-09 15:08:24,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c2831c5 >2013-12-09 15:08:25,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5c2831c5 >2013-12-09 15:08:25,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3cfdcd57 >2013-12-09 15:08:25,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3cfdcd57 >2013-12-09 15:08:30,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 456b1e1 >2013-12-09 15:08:30,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 456b1e1 >2013-12-09 15:08:30,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e915fe0 >2013-12-09 15:08:31,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e915fe0 >2013-12-09 15:08:36,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6782ae29 >2013-12-09 15:08:36,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6782ae29 >2013-12-09 15:08:36,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21b68839 >2013-12-09 15:08:36,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21b68839 >2013-12-09 15:08:41,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7503a5f6 >2013-12-09 15:08:42,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7503a5f6 >2013-12-09 15:08:42,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59a817e4 >2013-12-09 15:08:42,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59a817e4 >2013-12-09 15:08:47,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3dd5a387 >2013-12-09 15:08:48,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3dd5a387 >2013-12-09 15:08:48,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57c1cd6e >2013-12-09 15:08:48,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57c1cd6e >2013-12-09 15:08:53,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e521445 >2013-12-09 15:08:53,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e521445 >2013-12-09 15:08:53,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20f182e9 >2013-12-09 15:08:54,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20f182e9 >2013-12-09 15:08:59,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 167b2ee9 >2013-12-09 15:08:59,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 167b2ee9 >2013-12-09 15:08:59,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: bfd6507 >2013-12-09 15:08:59,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: bfd6507 >2013-12-09 15:09:04,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 358695a7 >2013-12-09 15:09:05,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 358695a7 >2013-12-09 15:09:05,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65d55498 >2013-12-09 15:09:05,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65d55498 >2013-12-09 15:09:10,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ef9caec >2013-12-09 15:09:11,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6ef9caec >2013-12-09 15:09:11,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: cd31eae >2013-12-09 15:09:11,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: cd31eae >2013-12-09 15:09:13,273 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-59) No up server in cluster >2013-12-09 15:09:13,273 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-59) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:09:13,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7aad61ba >2013-12-09 15:09:13,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7aad61ba >2013-12-09 15:09:16,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d1834ed >2013-12-09 15:09:17,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d1834ed >2013-12-09 15:09:17,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f21687b >2013-12-09 15:09:17,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f21687b >2013-12-09 15:09:22,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ea4fcf6 >2013-12-09 15:09:22,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3ea4fcf6 >2013-12-09 15:09:22,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: db996aa >2013-12-09 15:09:23,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: db996aa >2013-12-09 15:09:28,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3aa9078a >2013-12-09 15:09:28,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3aa9078a >2013-12-09 15:09:28,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10b4acbf >2013-12-09 15:09:28,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10b4acbf >2013-12-09 15:09:33,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 657c3354 >2013-12-09 15:09:34,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 657c3354 >2013-12-09 15:09:34,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9a4b4be >2013-12-09 15:09:34,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9a4b4be >2013-12-09 15:09:39,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5fbfc913 >2013-12-09 15:09:40,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5fbfc913 >2013-12-09 15:09:40,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bcc15f4 >2013-12-09 15:09:40,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4bcc15f4 >2013-12-09 15:09:45,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d7bdfbe >2013-12-09 15:09:46,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d7bdfbe >2013-12-09 15:09:46,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 110835dd >2013-12-09 15:09:46,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 110835dd >2013-12-09 15:09:51,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6fab5c11 >2013-12-09 15:09:51,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6fab5c11 >2013-12-09 15:09:51,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e3f5c04 >2013-12-09 15:09:52,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e3f5c04 >2013-12-09 15:09:57,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24a5b89f >2013-12-09 15:09:57,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 24a5b89f >2013-12-09 15:09:57,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6dd80b06 >2013-12-09 15:09:57,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6dd80b06 >2013-12-09 15:10:02,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: fb0efd7 >2013-12-09 15:10:03,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: fb0efd7 >2013-12-09 15:10:03,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 215e19df >2013-12-09 15:10:03,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 215e19df >2013-12-09 15:10:08,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 246703fe >2013-12-09 15:10:09,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 246703fe >2013-12-09 15:10:09,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c034803 >2013-12-09 15:10:09,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c034803 >2013-12-09 15:10:13,571 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-68) No up server in cluster >2013-12-09 15:10:13,572 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-68) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:10:13,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34725aff >2013-12-09 15:10:13,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterTasksListVDSCommand, return: [], log id: 34725aff >2013-12-09 15:10:14,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ae0918e >2013-12-09 15:10:14,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ae0918e >2013-12-09 15:10:14,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a8e5de3 >2013-12-09 15:10:15,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a8e5de3 >2013-12-09 15:10:20,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ad00b6b >2013-12-09 15:10:20,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1ad00b6b >2013-12-09 15:10:20,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 775ce141 >2013-12-09 15:10:20,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 775ce141 >2013-12-09 15:10:25,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e8a4c30 >2013-12-09 15:10:26,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6e8a4c30 >2013-12-09 15:10:26,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6edbe22d >2013-12-09 15:10:26,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6edbe22d >2013-12-09 15:10:31,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5fc1d15e >2013-12-09 15:10:32,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5fc1d15e >2013-12-09 15:10:32,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a5578 >2013-12-09 15:10:32,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a5578 >2013-12-09 15:10:37,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3286e234 >2013-12-09 15:10:38,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3286e234 >2013-12-09 15:10:38,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ee2d308 >2013-12-09 15:10:38,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ee2d308 >2013-12-09 15:10:43,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2061915c >2013-12-09 15:10:43,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2061915c >2013-12-09 15:10:43,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e7038bc >2013-12-09 15:10:44,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e7038bc >2013-12-09 15:10:49,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72c86f59 >2013-12-09 15:10:49,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 72c86f59 >2013-12-09 15:10:49,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a279925 >2013-12-09 15:10:49,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a279925 >2013-12-09 15:10:54,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 166fef56 >2013-12-09 15:10:55,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 166fef56 >2013-12-09 15:10:55,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6179258b >2013-12-09 15:10:55,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6179258b >2013-12-09 15:11:00,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 251c18a6 >2013-12-09 15:11:01,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 251c18a6 >2013-12-09 15:11:01,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30ddae17 >2013-12-09 15:11:01,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30ddae17 >2013-12-09 15:11:06,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 264da08c >2013-12-09 15:11:06,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 264da08c >2013-12-09 15:11:06,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d58ba1d >2013-12-09 15:11:07,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d58ba1d >2013-12-09 15:11:12,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3fb00a76 >2013-12-09 15:11:12,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3fb00a76 >2013-12-09 15:11:12,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 313c42e9 >2013-12-09 15:11:13,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 313c42e9 >2013-12-09 15:11:13,853 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-62) No up server in cluster >2013-12-09 15:11:13,853 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-62) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:11:13,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ee6db81 >2013-12-09 15:11:14,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4ee6db81 >2013-12-09 15:11:18,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 421614b4 >2013-12-09 15:11:18,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 421614b4 >2013-12-09 15:11:18,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75d65133 >2013-12-09 15:11:18,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75d65133 >2013-12-09 15:11:23,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7623f41b >2013-12-09 15:11:24,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7623f41b >2013-12-09 15:11:24,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b167859 >2013-12-09 15:11:24,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b167859 >2013-12-09 15:11:29,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b75aa31 >2013-12-09 15:11:30,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1b75aa31 >2013-12-09 15:11:30,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 11b88a5 >2013-12-09 15:11:30,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11b88a5 >2013-12-09 15:11:35,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79ad283a >2013-12-09 15:11:35,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 79ad283a >2013-12-09 15:11:35,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a98e6ca >2013-12-09 15:11:36,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a98e6ca >2013-12-09 15:11:41,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1583a995 >2013-12-09 15:11:41,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1583a995 >2013-12-09 15:11:41,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70569b29 >2013-12-09 15:11:41,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70569b29 >2013-12-09 15:11:46,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 336bdce4 >2013-12-09 15:11:47,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 336bdce4 >2013-12-09 15:11:47,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21793eb3 >2013-12-09 15:11:47,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21793eb3 >2013-12-09 15:11:52,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d2d6f47 >2013-12-09 15:11:53,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: d2d6f47 >2013-12-09 15:11:53,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 334b477 >2013-12-09 15:11:53,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 334b477 >2013-12-09 15:11:58,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7be4ceb7 >2013-12-09 15:11:58,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7be4ceb7 >2013-12-09 15:11:58,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32c686b8 >2013-12-09 15:11:59,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32c686b8 >2013-12-09 15:12:04,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48b5979b >2013-12-09 15:12:04,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 48b5979b >2013-12-09 15:12:04,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b20eca >2013-12-09 15:12:04,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b20eca >2013-12-09 15:12:09,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e978663 >2013-12-09 15:12:10,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3e978663 >2013-12-09 15:12:10,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 89a0af6 >2013-12-09 15:12:10,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 89a0af6 >2013-12-09 15:12:14,145 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-63) No up server in cluster >2013-12-09 15:12:14,145 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-63) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:12:14,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 287135ea >2013-12-09 15:12:14,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterTasksListVDSCommand, return: [], log id: 287135ea >2013-12-09 15:12:15,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f9a56f5 >2013-12-09 15:12:16,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5f9a56f5 >2013-12-09 15:12:16,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c17f97f >2013-12-09 15:12:16,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c17f97f >2013-12-09 15:12:21,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20d43000 >2013-12-09 15:12:21,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 20d43000 >2013-12-09 15:12:21,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f41c598 >2013-12-09 15:12:22,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f41c598 >2013-12-09 15:12:27,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 417a8381 >2013-12-09 15:12:27,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 417a8381 >2013-12-09 15:12:27,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ebf5f3b >2013-12-09 15:12:28,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ebf5f3b >2013-12-09 15:12:33,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 265ebc3b >2013-12-09 15:12:33,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 265ebc3b >2013-12-09 15:12:33,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c18c769 >2013-12-09 15:12:33,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c18c769 >2013-12-09 15:12:38,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10bfb24a >2013-12-09 15:12:39,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 10bfb24a >2013-12-09 15:12:39,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 184307ab >2013-12-09 15:12:39,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 184307ab >2013-12-09 15:12:44,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c79a2eb >2013-12-09 15:12:45,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2c79a2eb >2013-12-09 15:12:45,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4fe3b849 >2013-12-09 15:12:45,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fe3b849 >2013-12-09 15:12:50,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bfca8b4 >2013-12-09 15:12:50,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4bfca8b4 >2013-12-09 15:12:50,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57a7066e >2013-12-09 15:12:51,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57a7066e >2013-12-09 15:12:56,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70e9694e >2013-12-09 15:12:56,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 70e9694e >2013-12-09 15:12:56,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d5b9337 >2013-12-09 15:12:56,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d5b9337 >2013-12-09 15:13:01,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44e8d58a >2013-12-09 15:13:02,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 44e8d58a >2013-12-09 15:13:02,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 102f25ab >2013-12-09 15:13:02,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 102f25ab >2013-12-09 15:13:07,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 14fac9d5 >2013-12-09 15:13:08,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 14fac9d5 >2013-12-09 15:13:08,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1da612bc >2013-12-09 15:13:08,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1da612bc >2013-12-09 15:13:13,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 106d059a >2013-12-09 15:13:13,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 106d059a >2013-12-09 15:13:13,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 657e8976 >2013-12-09 15:13:14,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 657e8976 >2013-12-09 15:13:14,436 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-73) No up server in cluster >2013-12-09 15:13:14,436 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-73) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:13:14,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e16e2b >2013-12-09 15:13:14,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterTasksListVDSCommand, return: [], log id: e16e2b >2013-12-09 15:13:19,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3bd8e94d >2013-12-09 15:13:19,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3bd8e94d >2013-12-09 15:13:19,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4fbb2595 >2013-12-09 15:13:20,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fbb2595 >2013-12-09 15:13:25,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7bf0eb3d >2013-12-09 15:13:25,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7bf0eb3d >2013-12-09 15:13:25,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d1080e4 >2013-12-09 15:13:25,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d1080e4 >2013-12-09 15:13:30,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d8ea294 >2013-12-09 15:13:31,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7d8ea294 >2013-12-09 15:13:31,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 669cb4a2 >2013-12-09 15:13:31,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 669cb4a2 >2013-12-09 15:13:36,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f48a1b3 >2013-12-09 15:13:37,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7f48a1b3 >2013-12-09 15:13:37,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32b3e4b9 >2013-12-09 15:13:37,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32b3e4b9 >2013-12-09 15:13:42,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b3f27e8 >2013-12-09 15:13:42,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3b3f27e8 >2013-12-09 15:13:42,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19be7082 >2013-12-09 15:13:43,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19be7082 >2013-12-09 15:13:48,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 402400e2 >2013-12-09 15:13:48,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 402400e2 >2013-12-09 15:13:48,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e002d7c >2013-12-09 15:13:48,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e002d7c >2013-12-09 15:13:53,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d628a33 >2013-12-09 15:13:54,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5d628a33 >2013-12-09 15:13:54,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f2e18dc >2013-12-09 15:13:54,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f2e18dc >2013-12-09 15:13:59,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42ea5ff0 >2013-12-09 15:14:00,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42ea5ff0 >2013-12-09 15:14:00,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e4a3eec >2013-12-09 15:14:00,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e4a3eec >2013-12-09 15:14:05,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56225673 >2013-12-09 15:14:06,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 56225673 >2013-12-09 15:14:06,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18dc17da >2013-12-09 15:14:06,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18dc17da >2013-12-09 15:14:11,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c447a88 >2013-12-09 15:14:11,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c447a88 >2013-12-09 15:14:11,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1dc9e0bd >2013-12-09 15:14:12,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1dc9e0bd >2013-12-09 15:14:14,725 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-40) No up server in cluster >2013-12-09 15:14:14,725 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-40) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:14:14,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72b24f5b >2013-12-09 15:14:15,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterTasksListVDSCommand, return: [], log id: 72b24f5b >2013-12-09 15:14:17,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a5208a0 >2013-12-09 15:14:17,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4a5208a0 >2013-12-09 15:14:17,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ec697bf >2013-12-09 15:14:17,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ec697bf >2013-12-09 15:14:22,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12dc8ccc >2013-12-09 15:14:23,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 12dc8ccc >2013-12-09 15:14:23,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36dabf78 >2013-12-09 15:14:23,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36dabf78 >2013-12-09 15:14:28,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7098df9f >2013-12-09 15:14:29,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7098df9f >2013-12-09 15:14:29,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42fb8821 >2013-12-09 15:14:29,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42fb8821 >2013-12-09 15:14:34,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 96f46ab >2013-12-09 15:14:34,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 96f46ab >2013-12-09 15:14:34,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7dc8ae40 >2013-12-09 15:14:35,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7dc8ae40 >2013-12-09 15:14:40,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1cf04cc5 >2013-12-09 15:14:40,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1cf04cc5 >2013-12-09 15:14:40,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51baa77b >2013-12-09 15:14:41,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51baa77b >2013-12-09 15:14:46,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18442c03 >2013-12-09 15:14:46,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 18442c03 >2013-12-09 15:14:46,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3cb58534 >2013-12-09 15:14:46,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3cb58534 >2013-12-09 15:14:51,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6324a8d1 >2013-12-09 15:14:52,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6324a8d1 >2013-12-09 15:14:52,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33dbf00a >2013-12-09 15:14:52,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33dbf00a >2013-12-09 15:14:57,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ee4c186 >2013-12-09 15:14:58,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1ee4c186 >2013-12-09 15:14:58,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 731a0441 >2013-12-09 15:14:58,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 731a0441 >2013-12-09 15:15:03,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3993fa7b >2013-12-09 15:15:03,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3993fa7b >2013-12-09 15:15:03,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b099d65 >2013-12-09 15:15:04,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b099d65 >2013-12-09 15:15:09,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2739e0b4 >2013-12-09 15:15:09,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2739e0b4 >2013-12-09 15:15:09,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f6ffe41 >2013-12-09 15:15:09,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f6ffe41 >2013-12-09 15:15:14,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30814c1c >2013-12-09 15:15:15,017 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-64) No up server in cluster >2013-12-09 15:15:15,017 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-64) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:15:15,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 489ef50 >2013-12-09 15:15:15,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterTasksListVDSCommand, return: [], log id: 489ef50 >2013-12-09 15:15:15,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 30814c1c >2013-12-09 15:15:15,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 421806ce >2013-12-09 15:15:15,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 421806ce >2013-12-09 15:15:20,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b73b3eb >2013-12-09 15:15:21,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7b73b3eb >2013-12-09 15:15:21,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 638c8b58 >2013-12-09 15:15:21,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 638c8b58 >2013-12-09 15:15:26,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24233426 >2013-12-09 15:15:26,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 24233426 >2013-12-09 15:15:26,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f86503b >2013-12-09 15:15:27,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f86503b >2013-12-09 15:15:32,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e29d209 >2013-12-09 15:15:32,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6e29d209 >2013-12-09 15:15:32,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d985b42 >2013-12-09 15:15:33,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d985b42 >2013-12-09 15:15:38,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42928e26 >2013-12-09 15:15:38,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42928e26 >2013-12-09 15:15:38,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d442ea0 >2013-12-09 15:15:38,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d442ea0 >2013-12-09 15:15:43,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f9e236c >2013-12-09 15:15:44,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f9e236c >2013-12-09 15:15:44,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 587922eb >2013-12-09 15:15:44,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 587922eb >2013-12-09 15:15:49,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 147d79c7 >2013-12-09 15:15:50,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 147d79c7 >2013-12-09 15:15:50,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17f599d0 >2013-12-09 15:15:50,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17f599d0 >2013-12-09 15:15:55,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: de65605 >2013-12-09 15:15:55,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: de65605 >2013-12-09 15:15:55,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a465907 >2013-12-09 15:15:56,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a465907 >2013-12-09 15:16:01,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 303753ef >2013-12-09 15:16:01,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 303753ef >2013-12-09 15:16:01,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 326d915c >2013-12-09 15:16:01,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 326d915c >2013-12-09 15:16:06,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53a5f41f >2013-12-09 15:16:07,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 53a5f41f >2013-12-09 15:16:07,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5bc661b8 >2013-12-09 15:16:07,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5bc661b8 >2013-12-09 15:16:12,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1966d049 >2013-12-09 15:16:13,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1966d049 >2013-12-09 15:16:13,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34afec2e >2013-12-09 15:16:13,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34afec2e >2013-12-09 15:16:15,287 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-54) No up server in cluster >2013-12-09 15:16:15,287 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-54) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:16:15,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a170aaa >2013-12-09 15:16:15,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2a170aaa >2013-12-09 15:16:18,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ad7fbbc >2013-12-09 15:16:19,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7ad7fbbc >2013-12-09 15:16:19,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e4c5210 >2013-12-09 15:16:19,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e4c5210 >2013-12-09 15:16:24,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 158d8276 >2013-12-09 15:16:24,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 158d8276 >2013-12-09 15:16:24,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f568082 >2013-12-09 15:16:25,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f568082 >2013-12-09 15:16:30,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57024118 >2013-12-09 15:16:30,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 57024118 >2013-12-09 15:16:30,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61658a8c >2013-12-09 15:16:30,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61658a8c >2013-12-09 15:16:35,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5721f236 >2013-12-09 15:16:36,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5721f236 >2013-12-09 15:16:36,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5307e7d8 >2013-12-09 15:16:36,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5307e7d8 >2013-12-09 15:16:41,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ad4c503 >2013-12-09 15:16:42,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3ad4c503 >2013-12-09 15:16:42,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56fc7fa6 >2013-12-09 15:16:42,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56fc7fa6 >2013-12-09 15:16:47,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6211abf >2013-12-09 15:16:47,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6211abf >2013-12-09 15:16:47,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d76a8ef >2013-12-09 15:16:48,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d76a8ef >2013-12-09 15:16:53,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c47ecad >2013-12-09 15:16:53,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c47ecad >2013-12-09 15:16:53,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13224a22 >2013-12-09 15:16:53,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13224a22 >2013-12-09 15:16:58,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26a9cc7b >2013-12-09 15:16:59,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 26a9cc7b >2013-12-09 15:16:59,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20bfdf16 >2013-12-09 15:16:59,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20bfdf16 >2013-12-09 15:17:04,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35feb5cd >2013-12-09 15:17:05,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 35feb5cd >2013-12-09 15:17:05,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74120c51 >2013-12-09 15:17:05,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74120c51 >2013-12-09 15:17:10,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 780cd207 >2013-12-09 15:17:11,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 780cd207 >2013-12-09 15:17:11,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24144278 >2013-12-09 15:17:11,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24144278 >2013-12-09 15:17:15,566 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-75) No up server in cluster >2013-12-09 15:17:15,566 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-75) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:17:15,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6865fe3b >2013-12-09 15:17:15,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6865fe3b >2013-12-09 15:17:16,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4aa479b4 >2013-12-09 15:17:16,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4aa479b4 >2013-12-09 15:17:16,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e73f987 >2013-12-09 15:17:17,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e73f987 >2013-12-09 15:17:22,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 189fc263 >2013-12-09 15:17:22,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 189fc263 >2013-12-09 15:17:22,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 24165b95 >2013-12-09 15:17:22,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24165b95 >2013-12-09 15:17:27,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b6c7d56 >2013-12-09 15:17:28,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5b6c7d56 >2013-12-09 15:17:28,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 105ae8e6 >2013-12-09 15:17:28,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 105ae8e6 >2013-12-09 15:17:33,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a4670d6 >2013-12-09 15:17:34,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3a4670d6 >2013-12-09 15:17:34,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4263c3ab >2013-12-09 15:17:34,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4263c3ab >2013-12-09 15:17:39,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b25da60 >2013-12-09 15:17:39,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b25da60 >2013-12-09 15:17:39,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ff76e5f >2013-12-09 15:17:40,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ff76e5f >2013-12-09 15:17:45,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62b195a0 >2013-12-09 15:17:45,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 62b195a0 >2013-12-09 15:17:45,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c801114 >2013-12-09 15:17:45,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c801114 >2013-12-09 15:17:50,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45799743 >2013-12-09 15:17:51,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 45799743 >2013-12-09 15:17:51,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18cb9be7 >2013-12-09 15:17:51,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18cb9be7 >2013-12-09 15:17:56,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 186ed168 >2013-12-09 15:17:57,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 186ed168 >2013-12-09 15:17:57,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 689653a5 >2013-12-09 15:17:57,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 689653a5 >2013-12-09 15:18:02,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4db15a18 >2013-12-09 15:18:03,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4db15a18 >2013-12-09 15:18:03,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72aaa38e >2013-12-09 15:18:03,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72aaa38e >2013-12-09 15:18:08,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b377258 >2013-12-09 15:18:08,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b377258 >2013-12-09 15:18:08,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 100a103e >2013-12-09 15:18:09,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 100a103e >2013-12-09 15:18:14,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c7ec053 >2013-12-09 15:18:14,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3c7ec053 >2013-12-09 15:18:14,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27e8d9d6 >2013-12-09 15:18:14,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27e8d9d6 >2013-12-09 15:18:15,839 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-58) No up server in cluster >2013-12-09 15:18:15,839 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-58) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:18:15,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4eeac79a >2013-12-09 15:18:16,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4eeac79a >2013-12-09 15:18:19,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ebb0032 >2013-12-09 15:18:20,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ebb0032 >2013-12-09 15:18:20,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 250111d9 >2013-12-09 15:18:20,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 250111d9 >2013-12-09 15:18:25,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6248c6d5 >2013-12-09 15:18:26,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6248c6d5 >2013-12-09 15:18:26,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7250bb77 >2013-12-09 15:18:26,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7250bb77 >2013-12-09 15:18:31,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72f6e290 >2013-12-09 15:18:32,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 72f6e290 >2013-12-09 15:18:32,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f813c21 >2013-12-09 15:18:32,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f813c21 >2013-12-09 15:18:37,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 674da315 >2013-12-09 15:18:37,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 674da315 >2013-12-09 15:18:37,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65e8ede0 >2013-12-09 15:18:38,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65e8ede0 >2013-12-09 15:18:43,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ddaae6e >2013-12-09 15:18:43,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ddaae6e >2013-12-09 15:18:43,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ebd400d >2013-12-09 15:18:43,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ebd400d >2013-12-09 15:18:48,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 723202ce >2013-12-09 15:18:49,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 723202ce >2013-12-09 15:18:49,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b0cf990 >2013-12-09 15:18:49,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b0cf990 >2013-12-09 15:18:54,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b370f7b >2013-12-09 15:18:55,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b370f7b >2013-12-09 15:18:55,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35454df2 >2013-12-09 15:18:55,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35454df2 >2013-12-09 15:19:00,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2cc4f128 >2013-12-09 15:19:00,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2cc4f128 >2013-12-09 15:19:00,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a799f11 >2013-12-09 15:19:01,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a799f11 >2013-12-09 15:19:06,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 727b38b >2013-12-09 15:19:06,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 727b38b >2013-12-09 15:19:06,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2db527de >2013-12-09 15:19:06,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2db527de >2013-12-09 15:19:11,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68f368bf >2013-12-09 15:19:12,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 68f368bf >2013-12-09 15:19:12,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53b499f4 >2013-12-09 15:19:12,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53b499f4 >2013-12-09 15:19:16,120 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-48) No up server in cluster >2013-12-09 15:19:16,121 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-48) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:19:16,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2680576f >2013-12-09 15:19:16,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2680576f >2013-12-09 15:19:17,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d3e845f >2013-12-09 15:19:18,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d3e845f >2013-12-09 15:19:18,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36056542 >2013-12-09 15:19:18,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36056542 >2013-12-09 15:19:23,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54920757 >2013-12-09 15:19:24,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 54920757 >2013-12-09 15:19:24,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bd1b1ef >2013-12-09 15:19:24,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bd1b1ef >2013-12-09 15:19:29,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a1aa012 >2013-12-09 15:19:29,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2a1aa012 >2013-12-09 15:19:29,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 256521c2 >2013-12-09 15:19:30,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 256521c2 >2013-12-09 15:19:35,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2974b04d >2013-12-09 15:19:35,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2974b04d >2013-12-09 15:19:35,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2dedd5f7 >2013-12-09 15:19:35,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2dedd5f7 >2013-12-09 15:19:40,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 325727e4 >2013-12-09 15:19:41,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 325727e4 >2013-12-09 15:19:41,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3820a057 >2013-12-09 15:19:41,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3820a057 >2013-12-09 15:19:46,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: cf7ebfe >2013-12-09 15:19:47,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: cf7ebfe >2013-12-09 15:19:47,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13190ee2 >2013-12-09 15:19:47,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13190ee2 >2013-12-09 15:19:52,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e1b1d8d >2013-12-09 15:19:52,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3e1b1d8d >2013-12-09 15:19:52,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4dfee1b6 >2013-12-09 15:19:53,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4dfee1b6 >2013-12-09 15:19:58,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 776c6591 >2013-12-09 15:19:58,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 776c6591 >2013-12-09 15:19:58,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41555778 >2013-12-09 15:19:58,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41555778 >2013-12-09 15:20:03,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45b994b >2013-12-09 15:20:04,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 45b994b >2013-12-09 15:20:04,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 788dc93 >2013-12-09 15:20:04,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 788dc93 >2013-12-09 15:20:09,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4af0e4ed >2013-12-09 15:20:10,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4af0e4ed >2013-12-09 15:20:10,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58374b9b >2013-12-09 15:20:10,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58374b9b >2013-12-09 15:20:15,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3fa49ec1 >2013-12-09 15:20:16,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3fa49ec1 >2013-12-09 15:20:16,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 93cefab >2013-12-09 15:20:16,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 93cefab >2013-12-09 15:20:16,396 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-53) No up server in cluster >2013-12-09 15:20:16,397 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-53) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:20:16,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7310f72f >2013-12-09 15:20:16,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7310f72f >2013-12-09 15:20:21,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46eae73c >2013-12-09 15:20:21,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 46eae73c >2013-12-09 15:20:21,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48fdbf60 >2013-12-09 15:20:22,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48fdbf60 >2013-12-09 15:20:27,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ab14eef >2013-12-09 15:20:27,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ab14eef >2013-12-09 15:20:27,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f9f8558 >2013-12-09 15:20:27,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f9f8558 >2013-12-09 15:20:32,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 465fe000 >2013-12-09 15:20:33,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 465fe000 >2013-12-09 15:20:33,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c1daf74 >2013-12-09 15:20:33,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c1daf74 >2013-12-09 15:20:38,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45104794 >2013-12-09 15:20:39,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 45104794 >2013-12-09 15:20:39,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c17400c >2013-12-09 15:20:39,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c17400c >2013-12-09 15:20:44,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1814c95f >2013-12-09 15:20:44,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1814c95f >2013-12-09 15:20:44,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 330c874e >2013-12-09 15:20:45,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 330c874e >2013-12-09 15:20:50,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 663389df >2013-12-09 15:20:50,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 663389df >2013-12-09 15:20:50,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 670ad3b8 >2013-12-09 15:20:51,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 670ad3b8 >2013-12-09 15:20:56,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ef928e2 >2013-12-09 15:20:56,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ef928e2 >2013-12-09 15:20:56,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e2da9e0 >2013-12-09 15:20:56,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e2da9e0 >2013-12-09 15:21:01,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66f89d66 >2013-12-09 15:21:02,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 66f89d66 >2013-12-09 15:21:02,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ad40402 >2013-12-09 15:21:02,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ad40402 >2013-12-09 15:21:07,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4287d5a3 >2013-12-09 15:21:08,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4287d5a3 >2013-12-09 15:21:08,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1cd56eb >2013-12-09 15:21:08,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1cd56eb >2013-12-09 15:21:13,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a3e0179 >2013-12-09 15:21:13,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4a3e0179 >2013-12-09 15:21:13,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 640b6ca0 >2013-12-09 15:21:14,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 640b6ca0 >2013-12-09 15:21:16,678 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-79) No up server in cluster >2013-12-09 15:21:16,678 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-79) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:21:16,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6de6c90f >2013-12-09 15:21:16,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6de6c90f >2013-12-09 15:21:19,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1739c477 >2013-12-09 15:21:19,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1739c477 >2013-12-09 15:21:19,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f48540d >2013-12-09 15:21:19,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f48540d >2013-12-09 15:21:24,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 424c36c3 >2013-12-09 15:21:25,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 424c36c3 >2013-12-09 15:21:25,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19ab5371 >2013-12-09 15:21:25,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19ab5371 >2013-12-09 15:21:30,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27b26f9c >2013-12-09 15:21:31,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 27b26f9c >2013-12-09 15:21:31,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6374c3a3 >2013-12-09 15:21:31,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6374c3a3 >2013-12-09 15:21:36,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11d16c7e >2013-12-09 15:21:37,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 11d16c7e >2013-12-09 15:21:37,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 450f21af >2013-12-09 15:21:37,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 450f21af >2013-12-09 15:21:42,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f488447 >2013-12-09 15:21:42,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: f488447 >2013-12-09 15:21:42,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a5e5c2 >2013-12-09 15:21:43,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a5e5c2 >2013-12-09 15:21:48,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 530fbe2f >2013-12-09 15:21:48,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 530fbe2f >2013-12-09 15:21:48,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a13beac >2013-12-09 15:21:48,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a13beac >2013-12-09 15:21:53,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57f0fcfd >2013-12-09 15:21:54,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 57f0fcfd >2013-12-09 15:21:54,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20d13c33 >2013-12-09 15:21:54,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20d13c33 >2013-12-09 15:21:59,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5e81acf1 >2013-12-09 15:22:00,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5e81acf1 >2013-12-09 15:22:00,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3928a0ed >2013-12-09 15:22:00,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3928a0ed >2013-12-09 15:22:05,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b6efcc4 >2013-12-09 15:22:05,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b6efcc4 >2013-12-09 15:22:05,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f896d12 >2013-12-09 15:22:06,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f896d12 >2013-12-09 15:22:11,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74de976e >2013-12-09 15:22:11,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 74de976e >2013-12-09 15:22:11,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3305f5fe >2013-12-09 15:22:11,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3305f5fe >2013-12-09 15:22:16,966 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-52) No up server in cluster >2013-12-09 15:22:16,966 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-52) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:22:16,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33eecc7d >2013-12-09 15:22:16,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32dc3774 >2013-12-09 15:22:17,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterTasksListVDSCommand, return: [], log id: 33eecc7d >2013-12-09 15:22:17,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 32dc3774 >2013-12-09 15:22:17,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b3a9c1 >2013-12-09 15:22:17,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b3a9c1 >2013-12-09 15:22:22,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c0f8208 >2013-12-09 15:22:23,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c0f8208 >2013-12-09 15:22:23,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44edacbf >2013-12-09 15:22:23,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44edacbf >2013-12-09 15:22:28,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 111f2aaf >2013-12-09 15:22:29,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 111f2aaf >2013-12-09 15:22:29,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64277cd3 >2013-12-09 15:22:29,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64277cd3 >2013-12-09 15:22:34,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1052dfdf >2013-12-09 15:22:34,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1052dfdf >2013-12-09 15:22:34,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 578ac8ef >2013-12-09 15:22:35,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 578ac8ef >2013-12-09 15:22:40,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19a8485 >2013-12-09 15:22:40,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 19a8485 >2013-12-09 15:22:40,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f3fa53c >2013-12-09 15:22:40,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f3fa53c >2013-12-09 15:22:45,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b0e9757 >2013-12-09 15:22:46,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: b0e9757 >2013-12-09 15:22:46,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7cd29cee >2013-12-09 15:22:46,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7cd29cee >2013-12-09 15:22:51,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c234483 >2013-12-09 15:22:52,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7c234483 >2013-12-09 15:22:52,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20a18275 >2013-12-09 15:22:52,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20a18275 >2013-12-09 15:22:57,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 554825ea >2013-12-09 15:22:57,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 554825ea >2013-12-09 15:22:57,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26e969f0 >2013-12-09 15:22:58,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26e969f0 >2013-12-09 15:23:03,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4520bf4f >2013-12-09 15:23:03,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4520bf4f >2013-12-09 15:23:03,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 560fcce6 >2013-12-09 15:23:04,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 560fcce6 >2013-12-09 15:23:09,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 941a3e7 >2013-12-09 15:23:09,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 941a3e7 >2013-12-09 15:23:09,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d93ec9f >2013-12-09 15:23:09,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d93ec9f >2013-12-09 15:23:14,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52688f4f >2013-12-09 15:23:15,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 52688f4f >2013-12-09 15:23:15,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 756f6fca >2013-12-09 15:23:15,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 756f6fca >2013-12-09 15:23:17,246 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-44) No up server in cluster >2013-12-09 15:23:17,247 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-44) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:23:17,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23e302ba >2013-12-09 15:23:17,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterTasksListVDSCommand, return: [], log id: 23e302ba >2013-12-09 15:23:20,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2731d744 >2013-12-09 15:23:21,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2731d744 >2013-12-09 15:23:21,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77651c45 >2013-12-09 15:23:21,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77651c45 >2013-12-09 15:23:26,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5243b035 >2013-12-09 15:23:26,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5243b035 >2013-12-09 15:23:26,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11592d6c >2013-12-09 15:23:27,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11592d6c >2013-12-09 15:23:32,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6db1da9d >2013-12-09 15:23:32,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6db1da9d >2013-12-09 15:23:32,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34051e07 >2013-12-09 15:23:32,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34051e07 >2013-12-09 15:23:37,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ce14ce7 >2013-12-09 15:23:38,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ce14ce7 >2013-12-09 15:23:38,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5088dfe4 >2013-12-09 15:23:38,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5088dfe4 >2013-12-09 15:23:43,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31d36f07 >2013-12-09 15:23:44,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 31d36f07 >2013-12-09 15:23:44,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a62eae6 >2013-12-09 15:23:44,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a62eae6 >2013-12-09 15:23:49,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1721675b >2013-12-09 15:23:49,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1721675b >2013-12-09 15:23:49,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13943409 >2013-12-09 15:23:50,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13943409 >2013-12-09 15:23:55,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 497b790d >2013-12-09 15:23:55,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 497b790d >2013-12-09 15:23:55,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 640a901e >2013-12-09 15:23:55,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 640a901e >2013-12-09 15:24:00,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 60311d29 >2013-12-09 15:24:01,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 60311d29 >2013-12-09 15:24:01,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a67549a >2013-12-09 15:24:01,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a67549a >2013-12-09 15:24:06,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48c85644 >2013-12-09 15:24:07,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 48c85644 >2013-12-09 15:24:07,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 293285c8 >2013-12-09 15:24:07,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 293285c8 >2013-12-09 15:24:12,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17e4d099 >2013-12-09 15:24:13,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 17e4d099 >2013-12-09 15:24:13,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a6e79ec >2013-12-09 15:24:13,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a6e79ec >2013-12-09 15:24:17,528 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-73) No up server in cluster >2013-12-09 15:24:17,528 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-73) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:24:17,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c540db7 >2013-12-09 15:24:17,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7c540db7 >2013-12-09 15:24:18,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: bde1f14 >2013-12-09 15:24:18,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: bde1f14 >2013-12-09 15:24:18,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 654846d2 >2013-12-09 15:24:19,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 654846d2 >2013-12-09 15:24:24,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b2fe441 >2013-12-09 15:24:24,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4b2fe441 >2013-12-09 15:24:24,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c1e242c >2013-12-09 15:24:24,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c1e242c >2013-12-09 15:24:29,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2283b7d2 >2013-12-09 15:24:30,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2283b7d2 >2013-12-09 15:24:30,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c8ff6fd >2013-12-09 15:24:30,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c8ff6fd >2013-12-09 15:24:35,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 492c240c >2013-12-09 15:24:36,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 492c240c >2013-12-09 15:24:36,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 22ebd423 >2013-12-09 15:24:36,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22ebd423 >2013-12-09 15:24:41,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76d39f13 >2013-12-09 15:24:41,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 76d39f13 >2013-12-09 15:24:41,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 386025bd >2013-12-09 15:24:42,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 386025bd >2013-12-09 15:24:47,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8c1d1a3 >2013-12-09 15:24:47,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 8c1d1a3 >2013-12-09 15:24:47,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 432e038c >2013-12-09 15:24:47,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 432e038c >2013-12-09 15:24:53,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2579be8 >2013-12-09 15:24:53,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2579be8 >2013-12-09 15:24:53,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d99f80d >2013-12-09 15:24:53,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d99f80d >2013-12-09 15:24:58,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 166b5f31 >2013-12-09 15:24:59,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 166b5f31 >2013-12-09 15:24:59,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4320f28f >2013-12-09 15:24:59,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4320f28f >2013-12-09 15:25:04,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 261b2531 >2013-12-09 15:25:05,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 261b2531 >2013-12-09 15:25:05,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2becf8d7 >2013-12-09 15:25:05,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2becf8d7 >2013-12-09 15:25:10,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c9ff7f7 >2013-12-09 15:25:10,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1c9ff7f7 >2013-12-09 15:25:10,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61fad7be >2013-12-09 15:25:11,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61fad7be >2013-12-09 15:25:16,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 651e5e06 >2013-12-09 15:25:16,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 651e5e06 >2013-12-09 15:25:16,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47f62d86 >2013-12-09 15:25:16,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47f62d86 >2013-12-09 15:25:17,806 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-37) No up server in cluster >2013-12-09 15:25:17,806 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-37) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:25:17,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57aa557 >2013-12-09 15:25:18,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterTasksListVDSCommand, return: [], log id: 57aa557 >2013-12-09 15:25:21,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e561c7a >2013-12-09 15:25:22,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7e561c7a >2013-12-09 15:25:22,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 429669bf >2013-12-09 15:25:22,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 429669bf >2013-12-09 15:25:27,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53d54e49 >2013-12-09 15:25:28,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 53d54e49 >2013-12-09 15:25:28,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 629fd7f9 >2013-12-09 15:25:28,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 629fd7f9 >2013-12-09 15:25:33,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a0c4aff >2013-12-09 15:25:34,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a0c4aff >2013-12-09 15:25:34,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34a95148 >2013-12-09 15:25:34,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34a95148 >2013-12-09 15:25:39,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a0d0a65 >2013-12-09 15:25:39,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a0d0a65 >2013-12-09 15:25:39,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a5a5941 >2013-12-09 15:25:40,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a5a5941 >2013-12-09 15:25:45,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d75334c >2013-12-09 15:25:45,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6d75334c >2013-12-09 15:25:45,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 580cd564 >2013-12-09 15:25:45,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 580cd564 >2013-12-09 15:25:50,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 432afb8d >2013-12-09 15:25:51,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 432afb8d >2013-12-09 15:25:51,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ff7e49a >2013-12-09 15:25:51,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ff7e49a >2013-12-09 15:25:56,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f7487e9 >2013-12-09 15:25:57,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: f7487e9 >2013-12-09 15:25:57,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66e2a942 >2013-12-09 15:25:57,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66e2a942 >2013-12-09 15:26:02,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f93df0b >2013-12-09 15:26:02,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6f93df0b >2013-12-09 15:26:02,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 474cb4e1 >2013-12-09 15:26:03,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 474cb4e1 >2013-12-09 15:26:08,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a501b3c >2013-12-09 15:26:08,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4a501b3c >2013-12-09 15:26:08,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40457c56 >2013-12-09 15:26:08,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40457c56 >2013-12-09 15:26:13,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1001abc5 >2013-12-09 15:26:14,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1001abc5 >2013-12-09 15:26:14,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3803237a >2013-12-09 15:26:14,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3803237a >2013-12-09 15:26:18,090 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-28) No up server in cluster >2013-12-09 15:26:18,090 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-28) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:26:18,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1935368f >2013-12-09 15:26:18,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1935368f >2013-12-09 15:26:19,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29c24a83 >2013-12-09 15:26:20,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 29c24a83 >2013-12-09 15:26:20,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71c8388f >2013-12-09 15:26:20,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71c8388f >2013-12-09 15:26:25,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27e47acb >2013-12-09 15:26:26,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 27e47acb >2013-12-09 15:26:26,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3df9a34c >2013-12-09 15:26:26,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3df9a34c >2013-12-09 15:26:31,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a1db951 >2013-12-09 15:26:31,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1a1db951 >2013-12-09 15:26:31,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2986b5b1 >2013-12-09 15:26:32,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2986b5b1 >2013-12-09 15:26:37,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c40ea8c >2013-12-09 15:26:37,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c40ea8c >2013-12-09 15:26:37,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 786cb11e >2013-12-09 15:26:37,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 786cb11e >2013-12-09 15:26:42,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e93ec85 >2013-12-09 15:26:43,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e93ec85 >2013-12-09 15:26:43,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76f8ec72 >2013-12-09 15:26:43,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76f8ec72 >2013-12-09 15:26:48,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1dbe6053 >2013-12-09 15:26:49,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1dbe6053 >2013-12-09 15:26:49,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51bd5f6f >2013-12-09 15:26:49,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51bd5f6f >2013-12-09 15:26:54,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e804a1 >2013-12-09 15:26:54,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2e804a1 >2013-12-09 15:26:54,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6147fce7 >2013-12-09 15:26:55,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6147fce7 >2013-12-09 15:27:00,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 209ad9e5 >2013-12-09 15:27:00,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 209ad9e5 >2013-12-09 15:27:00,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6228dbf3 >2013-12-09 15:27:01,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6228dbf3 >2013-12-09 15:27:06,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 624ac9a1 >2013-12-09 15:27:06,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 624ac9a1 >2013-12-09 15:27:06,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19a8a401 >2013-12-09 15:27:06,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19a8a401 >2013-12-09 15:27:11,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1fa1dc92 >2013-12-09 15:27:12,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1fa1dc92 >2013-12-09 15:27:12,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 543aa36c >2013-12-09 15:27:12,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 543aa36c >2013-12-09 15:27:17,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d5240cb >2013-12-09 15:27:18,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: d5240cb >2013-12-09 15:27:18,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36403321 >2013-12-09 15:27:18,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36403321 >2013-12-09 15:27:18,376 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-54) No up server in cluster >2013-12-09 15:27:18,376 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-54) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:27:18,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f3da2a >2013-12-09 15:27:18,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7f3da2a >2013-12-09 15:27:23,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41b6b468 >2013-12-09 15:27:23,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 41b6b468 >2013-12-09 15:27:23,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46d1f34d >2013-12-09 15:27:24,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46d1f34d >2013-12-09 15:27:29,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4aeed119 >2013-12-09 15:27:29,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4aeed119 >2013-12-09 15:27:29,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5887a6bd >2013-12-09 15:27:29,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5887a6bd >2013-12-09 15:27:34,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1232875 >2013-12-09 15:27:35,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1232875 >2013-12-09 15:27:35,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c77c160 >2013-12-09 15:27:35,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c77c160 >2013-12-09 15:27:40,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d79a8d0 >2013-12-09 15:27:41,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6d79a8d0 >2013-12-09 15:27:41,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 24e41449 >2013-12-09 15:27:41,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24e41449 >2013-12-09 15:27:46,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e00a60c >2013-12-09 15:27:47,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2e00a60c >2013-12-09 15:27:47,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60bb8a17 >2013-12-09 15:27:47,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60bb8a17 >2013-12-09 15:27:52,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f7bdfef >2013-12-09 15:27:52,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5f7bdfef >2013-12-09 15:27:52,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f1d9b00 >2013-12-09 15:27:53,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f1d9b00 >2013-12-09 15:27:58,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ecaf20b >2013-12-09 15:27:58,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ecaf20b >2013-12-09 15:27:58,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 644af60d >2013-12-09 15:27:58,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 644af60d >2013-12-09 15:28:03,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ce2dd7a >2013-12-09 15:28:04,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5ce2dd7a >2013-12-09 15:28:04,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6aac7564 >2013-12-09 15:28:04,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6aac7564 >2013-12-09 15:28:09,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17b42e4 >2013-12-09 15:28:10,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 17b42e4 >2013-12-09 15:28:10,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36912cbe >2013-12-09 15:28:10,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36912cbe >2013-12-09 15:28:15,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1eb8a4ba >2013-12-09 15:28:15,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1eb8a4ba >2013-12-09 15:28:15,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39fb7ab2 >2013-12-09 15:28:16,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39fb7ab2 >2013-12-09 15:28:18,655 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-32) No up server in cluster >2013-12-09 15:28:18,655 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-32) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:28:18,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: df26e5a >2013-12-09 15:28:18,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterTasksListVDSCommand, return: [], log id: df26e5a >2013-12-09 15:28:21,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 518bbcdd >2013-12-09 15:28:21,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 518bbcdd >2013-12-09 15:28:21,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ac7a9d6 >2013-12-09 15:28:21,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ac7a9d6 >2013-12-09 15:28:26,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68cf3481 >2013-12-09 15:28:27,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 68cf3481 >2013-12-09 15:28:27,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ebfbe9e >2013-12-09 15:28:27,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ebfbe9e >2013-12-09 15:28:32,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23af4769 >2013-12-09 15:28:33,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 23af4769 >2013-12-09 15:28:33,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2874ccbf >2013-12-09 15:28:33,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2874ccbf >2013-12-09 15:28:38,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74817fbd >2013-12-09 15:28:38,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 74817fbd >2013-12-09 15:28:38,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f62184d >2013-12-09 15:28:39,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f62184d >2013-12-09 15:28:44,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ad6a1c >2013-12-09 15:28:44,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3ad6a1c >2013-12-09 15:28:44,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3df88e27 >2013-12-09 15:28:44,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3df88e27 >2013-12-09 15:28:50,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 525e71b8 >2013-12-09 15:28:50,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 525e71b8 >2013-12-09 15:28:50,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 617f70e >2013-12-09 15:28:50,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 617f70e >2013-12-09 15:28:55,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f3b17d4 >2013-12-09 15:28:56,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f3b17d4 >2013-12-09 15:28:56,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b03f14b >2013-12-09 15:28:56,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b03f14b >2013-12-09 15:29:01,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63c4044d >2013-12-09 15:29:02,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 63c4044d >2013-12-09 15:29:02,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b9a91a8 >2013-12-09 15:29:02,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b9a91a8 >2013-12-09 15:29:07,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72007728 >2013-12-09 15:29:07,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 72007728 >2013-12-09 15:29:07,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 242efa3d >2013-12-09 15:29:08,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 242efa3d >2013-12-09 15:29:13,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 567fb1b3 >2013-12-09 15:29:13,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 567fb1b3 >2013-12-09 15:29:13,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5fb4cc8f >2013-12-09 15:29:13,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fb4cc8f >2013-12-09 15:29:18,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30889405 >2013-12-09 15:29:18,931 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-6) No up server in cluster >2013-12-09 15:29:18,931 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-6) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:29:18,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 253eb194 >2013-12-09 15:29:19,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterTasksListVDSCommand, return: [], log id: 253eb194 >2013-12-09 15:29:19,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 30889405 >2013-12-09 15:29:19,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 307c84f1 >2013-12-09 15:29:19,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 307c84f1 >2013-12-09 15:29:24,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3fd3fe04 >2013-12-09 15:29:25,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3fd3fe04 >2013-12-09 15:29:25,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32679ed >2013-12-09 15:29:25,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32679ed >2013-12-09 15:29:30,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2747f7af >2013-12-09 15:29:30,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2747f7af >2013-12-09 15:29:30,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a57796f >2013-12-09 15:29:31,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a57796f >2013-12-09 15:29:36,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30980b75 >2013-12-09 15:29:36,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 30980b75 >2013-12-09 15:29:36,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6548e548 >2013-12-09 15:29:36,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6548e548 >2013-12-09 15:29:41,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e503b0a >2013-12-09 15:29:42,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e503b0a >2013-12-09 15:29:42,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4893bc07 >2013-12-09 15:29:42,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4893bc07 >2013-12-09 15:29:47,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e3d151c >2013-12-09 15:29:48,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: e3d151c >2013-12-09 15:29:48,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bd95038 >2013-12-09 15:29:48,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bd95038 >2013-12-09 15:29:53,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 752987ee >2013-12-09 15:29:54,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 752987ee >2013-12-09 15:29:54,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 798581c >2013-12-09 15:29:54,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 798581c >2013-12-09 15:29:59,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 756612f7 >2013-12-09 15:29:59,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 756612f7 >2013-12-09 15:29:59,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2cc6b363 >2013-12-09 15:30:00,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2cc6b363 >2013-12-09 15:30:05,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 625b916d >2013-12-09 15:30:05,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 625b916d >2013-12-09 15:30:05,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a18ad3 >2013-12-09 15:30:05,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a18ad3 >2013-12-09 15:30:10,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4dff0c31 >2013-12-09 15:30:11,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4dff0c31 >2013-12-09 15:30:11,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ef30981 >2013-12-09 15:30:11,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ef30981 >2013-12-09 15:30:16,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6437e849 >2013-12-09 15:30:17,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6437e849 >2013-12-09 15:30:17,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1fe266e9 >2013-12-09 15:30:17,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1fe266e9 >2013-12-09 15:30:19,198 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-46) No up server in cluster >2013-12-09 15:30:19,199 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-46) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:30:19,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 79a21e59 >2013-12-09 15:30:19,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterTasksListVDSCommand, return: [], log id: 79a21e59 >2013-12-09 15:30:22,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5683468 >2013-12-09 15:30:22,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5683468 >2013-12-09 15:30:22,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30d731b2 >2013-12-09 15:30:23,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30d731b2 >2013-12-09 15:30:28,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a15080e >2013-12-09 15:30:28,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3a15080e >2013-12-09 15:30:28,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 276b0a06 >2013-12-09 15:30:28,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 276b0a06 >2013-12-09 15:30:33,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 289056eb >2013-12-09 15:30:34,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 289056eb >2013-12-09 15:30:34,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63bfbca >2013-12-09 15:30:34,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63bfbca >2013-12-09 15:30:39,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62133d2d >2013-12-09 15:30:40,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 62133d2d >2013-12-09 15:30:40,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 443da95b >2013-12-09 15:30:40,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 443da95b >2013-12-09 15:30:45,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72af5c9d >2013-12-09 15:30:46,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 72af5c9d >2013-12-09 15:30:46,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4caa7326 >2013-12-09 15:30:46,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4caa7326 >2013-12-09 15:30:51,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c25a751 >2013-12-09 15:30:51,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c25a751 >2013-12-09 15:30:51,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47850300 >2013-12-09 15:30:52,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47850300 >2013-12-09 15:30:57,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40b44c86 >2013-12-09 15:30:57,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 40b44c86 >2013-12-09 15:30:57,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53bfa4a1 >2013-12-09 15:30:57,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53bfa4a1 >2013-12-09 15:31:02,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6fbba486 >2013-12-09 15:31:03,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6fbba486 >2013-12-09 15:31:03,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 224a336f >2013-12-09 15:31:03,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 224a336f >2013-12-09 15:31:08,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 651c9caf >2013-12-09 15:31:09,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 651c9caf >2013-12-09 15:31:09,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73ac065c >2013-12-09 15:31:09,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73ac065c >2013-12-09 15:31:14,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e010649 >2013-12-09 15:31:14,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e010649 >2013-12-09 15:31:14,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35254d9d >2013-12-09 15:31:15,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35254d9d >2013-12-09 15:31:19,480 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-8) No up server in cluster >2013-12-09 15:31:19,480 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-8) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:31:19,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5eec750e >2013-12-09 15:31:19,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5eec750e >2013-12-09 15:31:20,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 717777b9 >2013-12-09 15:31:20,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 717777b9 >2013-12-09 15:31:20,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a3eeb8f >2013-12-09 15:31:20,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a3eeb8f >2013-12-09 15:31:25,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 22e95735 >2013-12-09 15:31:26,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 22e95735 >2013-12-09 15:31:26,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4721ba28 >2013-12-09 15:31:26,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4721ba28 >2013-12-09 15:31:31,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34655a95 >2013-12-09 15:31:32,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 34655a95 >2013-12-09 15:31:32,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5353f0a6 >2013-12-09 15:31:32,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5353f0a6 >2013-12-09 15:31:37,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ac6859 >2013-12-09 15:31:37,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7ac6859 >2013-12-09 15:31:37,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3face4ef >2013-12-09 15:31:38,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3face4ef >2013-12-09 15:31:43,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e4be9d2 >2013-12-09 15:31:43,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3e4be9d2 >2013-12-09 15:31:43,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f3f02e7 >2013-12-09 15:31:44,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f3f02e7 >2013-12-09 15:31:49,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b7ffc49 >2013-12-09 15:31:49,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6b7ffc49 >2013-12-09 15:31:49,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ced3836 >2013-12-09 15:31:49,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ced3836 >2013-12-09 15:31:54,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55a70e6e >2013-12-09 15:31:55,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 55a70e6e >2013-12-09 15:31:55,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ca3e371 >2013-12-09 15:31:55,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ca3e371 >2013-12-09 15:32:00,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41c71e53 >2013-12-09 15:32:01,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 41c71e53 >2013-12-09 15:32:01,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2504d27d >2013-12-09 15:32:01,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2504d27d >2013-12-09 15:32:06,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20a45c7e >2013-12-09 15:32:06,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 20a45c7e >2013-12-09 15:32:06,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 541c6b92 >2013-12-09 15:32:07,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 541c6b92 >2013-12-09 15:32:12,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 746ab708 >2013-12-09 15:32:12,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 746ab708 >2013-12-09 15:32:12,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14e59036 >2013-12-09 15:32:12,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14e59036 >2013-12-09 15:32:17,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 786f480b >2013-12-09 15:32:18,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 786f480b >2013-12-09 15:32:18,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b369eea >2013-12-09 15:32:18,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b369eea >2013-12-09 15:32:19,766 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-64) No up server in cluster >2013-12-09 15:32:19,766 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-64) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:32:19,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ffba3b7 >2013-12-09 15:32:20,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3ffba3b7 >2013-12-09 15:32:23,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 790a4d19 >2013-12-09 15:32:24,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 790a4d19 >2013-12-09 15:32:24,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5744177 >2013-12-09 15:32:24,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5744177 >2013-12-09 15:32:29,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4464fb28 >2013-12-09 15:32:29,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4464fb28 >2013-12-09 15:32:29,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d161605 >2013-12-09 15:32:30,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d161605 >2013-12-09 15:32:35,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18246b2e >2013-12-09 15:32:35,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 18246b2e >2013-12-09 15:32:35,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53398fdf >2013-12-09 15:32:36,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53398fdf >2013-12-09 15:32:41,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59d6ca7f >2013-12-09 15:32:41,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 59d6ca7f >2013-12-09 15:32:41,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c7dde39 >2013-12-09 15:32:41,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c7dde39 >2013-12-09 15:32:46,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5039da15 >2013-12-09 15:32:47,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5039da15 >2013-12-09 15:32:47,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c3f81e2 >2013-12-09 15:32:47,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c3f81e2 >2013-12-09 15:32:52,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ddd5afc >2013-12-09 15:32:53,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: ddd5afc >2013-12-09 15:32:53,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b4b80d7 >2013-12-09 15:32:53,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b4b80d7 >2013-12-09 15:32:58,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ea7bcb >2013-12-09 15:32:58,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: ea7bcb >2013-12-09 15:32:58,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 87fe1bf >2013-12-09 15:32:59,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 87fe1bf >2013-12-09 15:33:04,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73e25cf2 >2013-12-09 15:33:04,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 73e25cf2 >2013-12-09 15:33:04,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59e2ad1f >2013-12-09 15:33:04,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59e2ad1f >2013-12-09 15:33:09,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c541868 >2013-12-09 15:33:10,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c541868 >2013-12-09 15:33:10,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3cccb434 >2013-12-09 15:33:10,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3cccb434 >2013-12-09 15:33:15,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32907584 >2013-12-09 15:33:16,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 32907584 >2013-12-09 15:33:16,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4b1c80be >2013-12-09 15:33:16,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b1c80be >2013-12-09 15:33:20,036 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-49) No up server in cluster >2013-12-09 15:33:20,036 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-49) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:33:20,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c2d26d >2013-12-09 15:33:20,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3c2d26d >2013-12-09 15:33:21,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46e354bc >2013-12-09 15:33:21,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 46e354bc >2013-12-09 15:33:21,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e659af9 >2013-12-09 15:33:22,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e659af9 >2013-12-09 15:33:27,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ca1cc0d >2013-12-09 15:33:27,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ca1cc0d >2013-12-09 15:33:27,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f1afe1 >2013-12-09 15:33:27,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f1afe1 >2013-12-09 15:33:33,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3dc3a1fc >2013-12-09 15:33:33,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3dc3a1fc >2013-12-09 15:33:33,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 458aae1f >2013-12-09 15:33:33,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 458aae1f >2013-12-09 15:33:38,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66b45104 >2013-12-09 15:33:39,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 66b45104 >2013-12-09 15:33:39,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 580fac01 >2013-12-09 15:33:39,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 580fac01 >2013-12-09 15:33:44,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 319cca4b >2013-12-09 15:33:45,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 319cca4b >2013-12-09 15:33:45,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a2ba387 >2013-12-09 15:33:45,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a2ba387 >2013-12-09 15:33:50,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3808003b >2013-12-09 15:33:50,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3808003b >2013-12-09 15:33:50,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6662a463 >2013-12-09 15:33:51,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6662a463 >2013-12-09 15:33:56,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b190f35 >2013-12-09 15:33:56,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b190f35 >2013-12-09 15:33:56,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e231c5 >2013-12-09 15:33:56,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e231c5 >2013-12-09 15:34:01,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68d2ff92 >2013-12-09 15:34:02,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 68d2ff92 >2013-12-09 15:34:02,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1cc1eaa8 >2013-12-09 15:34:02,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1cc1eaa8 >2013-12-09 15:34:07,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 15474c5a >2013-12-09 15:34:08,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 15474c5a >2013-12-09 15:34:08,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 572eec1e >2013-12-09 15:34:08,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 572eec1e >2013-12-09 15:34:13,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 758e466f >2013-12-09 15:34:13,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 758e466f >2013-12-09 15:34:13,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 526ffc9f >2013-12-09 15:34:14,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 526ffc9f >2013-12-09 15:34:19,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36c503fb >2013-12-09 15:34:19,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 36c503fb >2013-12-09 15:34:19,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a4f7676 >2013-12-09 15:34:19,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a4f7676 >2013-12-09 15:34:20,331 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-56) No up server in cluster >2013-12-09 15:34:20,331 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-56) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:34:20,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fb7336c >2013-12-09 15:34:20,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2fb7336c >2013-12-09 15:34:24,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 306c1e8a >2013-12-09 15:34:25,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 306c1e8a >2013-12-09 15:34:25,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79a52654 >2013-12-09 15:34:25,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79a52654 >2013-12-09 15:34:30,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70649276 >2013-12-09 15:34:31,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 70649276 >2013-12-09 15:34:31,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 772f6a4a >2013-12-09 15:34:31,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 772f6a4a >2013-12-09 15:34:36,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1438be66 >2013-12-09 15:34:37,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1438be66 >2013-12-09 15:34:37,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e498712 >2013-12-09 15:34:37,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e498712 >2013-12-09 15:34:42,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57ae00a9 >2013-12-09 15:34:42,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 57ae00a9 >2013-12-09 15:34:42,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6490f555 >2013-12-09 15:34:43,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6490f555 >2013-12-09 15:34:48,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3362e7f1 >2013-12-09 15:34:48,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3362e7f1 >2013-12-09 15:34:48,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45a60f2e >2013-12-09 15:34:48,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45a60f2e >2013-12-09 15:34:53,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5d9a3eb >2013-12-09 15:34:54,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5d9a3eb >2013-12-09 15:34:54,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e09cf1f >2013-12-09 15:34:54,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e09cf1f >2013-12-09 15:34:59,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b856c7f >2013-12-09 15:35:00,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6b856c7f >2013-12-09 15:35:00,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 354936e4 >2013-12-09 15:35:00,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 354936e4 >2013-12-09 15:35:05,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64b0e116 >2013-12-09 15:35:05,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 64b0e116 >2013-12-09 15:35:05,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37532486 >2013-12-09 15:35:06,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37532486 >2013-12-09 15:35:11,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78dee1ed >2013-12-09 15:35:11,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 78dee1ed >2013-12-09 15:35:11,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e5fbff5 >2013-12-09 15:35:11,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e5fbff5 >2013-12-09 15:35:16,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a7fb3c7 >2013-12-09 15:35:17,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a7fb3c7 >2013-12-09 15:35:17,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7633dfba >2013-12-09 15:35:17,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7633dfba >2013-12-09 15:35:20,608 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-20) No up server in cluster >2013-12-09 15:35:20,609 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-20) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:35:20,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b2c1b30 >2013-12-09 15:35:20,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterTasksListVDSCommand, return: [], log id: b2c1b30 >2013-12-09 15:35:22,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b63113 >2013-12-09 15:35:23,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3b63113 >2013-12-09 15:35:23,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f3531e5 >2013-12-09 15:35:23,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f3531e5 >2013-12-09 15:35:28,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46496cb0 >2013-12-09 15:35:29,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 46496cb0 >2013-12-09 15:35:29,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3023b9ca >2013-12-09 15:35:29,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3023b9ca >2013-12-09 15:35:34,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d16bf89 >2013-12-09 15:35:34,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d16bf89 >2013-12-09 15:35:34,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56b32d79 >2013-12-09 15:35:35,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56b32d79 >2013-12-09 15:35:40,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 411214de >2013-12-09 15:35:40,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 411214de >2013-12-09 15:35:40,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12134f41 >2013-12-09 15:35:40,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12134f41 >2013-12-09 15:35:45,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42b10982 >2013-12-09 15:35:46,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42b10982 >2013-12-09 15:35:46,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1703f003 >2013-12-09 15:35:46,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1703f003 >2013-12-09 15:35:51,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64765cb7 >2013-12-09 15:35:52,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 64765cb7 >2013-12-09 15:35:52,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 652f8444 >2013-12-09 15:35:52,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 652f8444 >2013-12-09 15:35:57,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ee1ffe7 >2013-12-09 15:35:57,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4ee1ffe7 >2013-12-09 15:35:57,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5cb0c49a >2013-12-09 15:35:58,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cb0c49a >2013-12-09 15:36:03,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f6ec1fd >2013-12-09 15:36:03,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f6ec1fd >2013-12-09 15:36:03,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7cab7f5a >2013-12-09 15:36:03,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7cab7f5a >2013-12-09 15:36:08,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6039170a >2013-12-09 15:36:09,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6039170a >2013-12-09 15:36:09,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43f73665 >2013-12-09 15:36:09,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43f73665 >2013-12-09 15:36:14,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66aba2eb >2013-12-09 15:36:15,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 66aba2eb >2013-12-09 15:36:15,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60fecab7 >2013-12-09 15:36:15,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60fecab7 >2013-12-09 15:36:20,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 165760cb >2013-12-09 15:36:20,899 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-78) No up server in cluster >2013-12-09 15:36:20,899 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-78) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:36:20,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26e6cfe5 >2013-12-09 15:36:20,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 165760cb >2013-12-09 15:36:20,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14bc8a31 >2013-12-09 15:36:21,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterTasksListVDSCommand, return: [], log id: 26e6cfe5 >2013-12-09 15:36:21,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14bc8a31 >2013-12-09 15:36:26,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f6eb2b9 >2013-12-09 15:36:26,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f6eb2b9 >2013-12-09 15:36:26,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66d9584d >2013-12-09 15:36:27,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66d9584d >2013-12-09 15:36:32,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e89998f >2013-12-09 15:36:32,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e89998f >2013-12-09 15:36:32,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 25b6fcca >2013-12-09 15:36:32,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25b6fcca >2013-12-09 15:36:37,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 613039bb >2013-12-09 15:36:38,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 613039bb >2013-12-09 15:36:38,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 400ba7f9 >2013-12-09 15:36:38,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 400ba7f9 >2013-12-09 15:36:43,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ffb5b0c >2013-12-09 15:36:44,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5ffb5b0c >2013-12-09 15:36:44,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d6d3e88 >2013-12-09 15:36:44,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d6d3e88 >2013-12-09 15:36:49,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 759a7ca8 >2013-12-09 15:36:49,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 759a7ca8 >2013-12-09 15:36:49,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2af67050 >2013-12-09 15:36:50,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2af67050 >2013-12-09 15:36:55,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 705f20db >2013-12-09 15:36:55,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 705f20db >2013-12-09 15:36:55,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f44da60 >2013-12-09 15:36:55,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f44da60 >2013-12-09 15:37:00,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10bd50c >2013-12-09 15:37:01,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 10bd50c >2013-12-09 15:37:01,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 108d9bdf >2013-12-09 15:37:01,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 108d9bdf >2013-12-09 15:37:06,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bbe213 >2013-12-09 15:37:07,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1bbe213 >2013-12-09 15:37:07,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10b97f71 >2013-12-09 15:37:07,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10b97f71 >2013-12-09 15:37:12,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d2f6399 >2013-12-09 15:37:12,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d2f6399 >2013-12-09 15:37:12,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 178c475a >2013-12-09 15:37:13,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 178c475a >2013-12-09 15:37:18,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 290f887c >2013-12-09 15:37:18,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 290f887c >2013-12-09 15:37:18,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b421413 >2013-12-09 15:37:18,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b421413 >2013-12-09 15:37:21,174 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-66) No up server in cluster >2013-12-09 15:37:21,174 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-66) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:37:21,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 274f6937 >2013-12-09 15:37:21,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterTasksListVDSCommand, return: [], log id: 274f6937 >2013-12-09 15:37:24,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4da96a09 >2013-12-09 15:37:24,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4da96a09 >2013-12-09 15:37:24,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66f80cf5 >2013-12-09 15:37:24,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66f80cf5 >2013-12-09 15:37:29,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2abba46d >2013-12-09 15:37:30,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2abba46d >2013-12-09 15:37:30,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2a81dbe2 >2013-12-09 15:37:30,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a81dbe2 >2013-12-09 15:37:35,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4bf7ba5e >2013-12-09 15:37:36,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4bf7ba5e >2013-12-09 15:37:36,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 15a62d7e >2013-12-09 15:37:36,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15a62d7e >2013-12-09 15:37:41,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15bc7ffd >2013-12-09 15:37:41,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 15bc7ffd >2013-12-09 15:37:41,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29178c55 >2013-12-09 15:37:42,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29178c55 >2013-12-09 15:37:47,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 791f3cbd >2013-12-09 15:37:47,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 791f3cbd >2013-12-09 15:37:47,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20a27769 >2013-12-09 15:37:47,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20a27769 >2013-12-09 15:37:52,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c25df >2013-12-09 15:37:53,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c25df >2013-12-09 15:37:53,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33a20cdb >2013-12-09 15:37:53,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33a20cdb >2013-12-09 15:37:58,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2327c3a2 >2013-12-09 15:37:59,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2327c3a2 >2013-12-09 15:37:59,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74a863bb >2013-12-09 15:37:59,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74a863bb >2013-12-09 15:38:04,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b43f2a6 >2013-12-09 15:38:04,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4b43f2a6 >2013-12-09 15:38:04,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15ec311b >2013-12-09 15:38:05,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15ec311b >2013-12-09 15:38:10,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 60c50971 >2013-12-09 15:38:10,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 60c50971 >2013-12-09 15:38:10,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a4a6756 >2013-12-09 15:38:11,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a4a6756 >2013-12-09 15:38:16,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72660d58 >2013-12-09 15:38:16,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 72660d58 >2013-12-09 15:38:16,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d0e679d >2013-12-09 15:38:16,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d0e679d >2013-12-09 15:38:21,456 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-100) No up server in cluster >2013-12-09 15:38:21,456 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-100) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:38:21,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70c3ac9d >2013-12-09 15:38:21,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterTasksListVDSCommand, return: [], log id: 70c3ac9d >2013-12-09 15:38:21,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71b65d59 >2013-12-09 15:38:22,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 71b65d59 >2013-12-09 15:38:22,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 239cb808 >2013-12-09 15:38:22,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 239cb808 >2013-12-09 15:38:27,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3162442 >2013-12-09 15:38:28,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3162442 >2013-12-09 15:38:28,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31647a08 >2013-12-09 15:38:28,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31647a08 >2013-12-09 15:38:33,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29db42f7 >2013-12-09 15:38:33,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 29db42f7 >2013-12-09 15:38:33,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 625a7ae2 >2013-12-09 15:38:34,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 625a7ae2 >2013-12-09 15:38:39,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 877cd88 >2013-12-09 15:38:39,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 877cd88 >2013-12-09 15:38:39,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56492cc4 >2013-12-09 15:38:39,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56492cc4 >2013-12-09 15:38:44,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5cb9d22f >2013-12-09 15:38:45,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5cb9d22f >2013-12-09 15:38:45,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10611091 >2013-12-09 15:38:45,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10611091 >2013-12-09 15:38:50,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43d0a1e0 >2013-12-09 15:38:51,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 43d0a1e0 >2013-12-09 15:38:51,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b2b0c75 >2013-12-09 15:38:51,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b2b0c75 >2013-12-09 15:38:56,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2873f580 >2013-12-09 15:38:56,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2873f580 >2013-12-09 15:38:56,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66867bab >2013-12-09 15:38:57,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66867bab >2013-12-09 15:39:02,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d98fc8e >2013-12-09 15:39:02,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d98fc8e >2013-12-09 15:39:02,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33985684 >2013-12-09 15:39:02,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33985684 >2013-12-09 15:39:07,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c203876 >2013-12-09 15:39:08,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c203876 >2013-12-09 15:39:08,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 502fd570 >2013-12-09 15:39:08,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 502fd570 >2013-12-09 15:39:13,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 158c864d >2013-12-09 15:39:14,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 158c864d >2013-12-09 15:39:14,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31685a33 >2013-12-09 15:39:14,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31685a33 >2013-12-09 15:39:19,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6dad61f0 >2013-12-09 15:39:20,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6dad61f0 >2013-12-09 15:39:20,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66f1f012 >2013-12-09 15:39:20,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66f1f012 >2013-12-09 15:39:21,738 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-62) No up server in cluster >2013-12-09 15:39:21,738 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-62) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:39:21,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ffe731a >2013-12-09 15:39:22,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4ffe731a >2013-12-09 15:39:25,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1df1cde0 >2013-12-09 15:39:25,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1df1cde0 >2013-12-09 15:39:25,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f85b04 >2013-12-09 15:39:26,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f85b04 >2013-12-09 15:39:31,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 13663fc7 >2013-12-09 15:39:31,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 13663fc7 >2013-12-09 15:39:31,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d5e35ce >2013-12-09 15:39:31,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d5e35ce >2013-12-09 15:39:36,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 888c166 >2013-12-09 15:39:37,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 888c166 >2013-12-09 15:39:37,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b79d6fc >2013-12-09 15:39:37,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b79d6fc >2013-12-09 15:39:42,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 503ee42f >2013-12-09 15:39:43,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 503ee42f >2013-12-09 15:39:43,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7098a98d >2013-12-09 15:39:43,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7098a98d >2013-12-09 15:39:48,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e394dca >2013-12-09 15:39:48,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: e394dca >2013-12-09 15:39:48,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71e5c5a8 >2013-12-09 15:39:49,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71e5c5a8 >2013-12-09 15:39:54,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54c1f58a >2013-12-09 15:39:54,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 54c1f58a >2013-12-09 15:39:54,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47cdf024 >2013-12-09 15:39:54,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47cdf024 >2013-12-09 15:40:00,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74282b14 >2013-12-09 15:40:00,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 74282b14 >2013-12-09 15:40:00,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44e037db >2013-12-09 15:40:00,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44e037db >2013-12-09 15:40:05,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 607b6c9f >2013-12-09 15:40:06,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 607b6c9f >2013-12-09 15:40:06,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 56e47c5f >2013-12-09 15:40:06,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56e47c5f >2013-12-09 15:40:11,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4eed7766 >2013-12-09 15:40:12,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4eed7766 >2013-12-09 15:40:12,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48fb3d6 >2013-12-09 15:40:12,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48fb3d6 >2013-12-09 15:40:17,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4dad4eca >2013-12-09 15:40:17,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4dad4eca >2013-12-09 15:40:17,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71066d8f >2013-12-09 15:40:18,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71066d8f >2013-12-09 15:40:22,009 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-7) No up server in cluster >2013-12-09 15:40:22,010 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-7) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:40:22,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45afb84f >2013-12-09 15:40:22,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterTasksListVDSCommand, return: [], log id: 45afb84f >2013-12-09 15:40:23,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35145775 >2013-12-09 15:40:23,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 35145775 >2013-12-09 15:40:23,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 640d0f58 >2013-12-09 15:40:23,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 640d0f58 >2013-12-09 15:40:28,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53c566bf >2013-12-09 15:40:29,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 53c566bf >2013-12-09 15:40:29,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31a3c0b5 >2013-12-09 15:40:29,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31a3c0b5 >2013-12-09 15:40:34,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59a79eba >2013-12-09 15:40:35,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 59a79eba >2013-12-09 15:40:35,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: eda5d4a >2013-12-09 15:40:35,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: eda5d4a >2013-12-09 15:40:40,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 103b465b >2013-12-09 15:40:40,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 103b465b >2013-12-09 15:40:40,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55e8c372 >2013-12-09 15:40:41,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55e8c372 >2013-12-09 15:40:46,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73093898 >2013-12-09 15:40:46,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 73093898 >2013-12-09 15:40:46,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 138e6004 >2013-12-09 15:40:47,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 138e6004 >2013-12-09 15:40:52,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5dea65cd >2013-12-09 15:40:52,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5dea65cd >2013-12-09 15:40:52,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 433414c8 >2013-12-09 15:40:52,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 433414c8 >2013-12-09 15:40:57,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40309953 >2013-12-09 15:40:58,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 40309953 >2013-12-09 15:40:58,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b2ed8ef >2013-12-09 15:40:58,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b2ed8ef >2013-12-09 15:41:03,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 455c9c51 >2013-12-09 15:41:04,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 455c9c51 >2013-12-09 15:41:04,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47c8b7e9 >2013-12-09 15:41:04,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47c8b7e9 >2013-12-09 15:41:09,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 480d12a >2013-12-09 15:41:09,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 480d12a >2013-12-09 15:41:09,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c74d255 >2013-12-09 15:41:10,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c74d255 >2013-12-09 15:41:15,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 473211a4 >2013-12-09 15:41:15,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 473211a4 >2013-12-09 15:41:15,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3eafbcb9 >2013-12-09 15:41:15,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3eafbcb9 >2013-12-09 15:41:20,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e87e84f >2013-12-09 15:41:21,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: e87e84f >2013-12-09 15:41:21,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7ba02a5f >2013-12-09 15:41:21,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ba02a5f >2013-12-09 15:41:22,282 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-73) No up server in cluster >2013-12-09 15:41:22,282 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-73) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:41:22,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39dab0f7 >2013-12-09 15:41:22,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterTasksListVDSCommand, return: [], log id: 39dab0f7 >2013-12-09 15:41:26,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a873570 >2013-12-09 15:41:27,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a873570 >2013-12-09 15:41:27,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35c787b9 >2013-12-09 15:41:27,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35c787b9 >2013-12-09 15:41:32,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 264af5a2 >2013-12-09 15:41:33,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 264af5a2 >2013-12-09 15:41:33,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7df52b6a >2013-12-09 15:41:33,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7df52b6a >2013-12-09 15:41:38,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20d3a53b >2013-12-09 15:41:38,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 20d3a53b >2013-12-09 15:41:38,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6512a5a0 >2013-12-09 15:41:39,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6512a5a0 >2013-12-09 15:41:44,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10c53d5c >2013-12-09 15:41:44,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 10c53d5c >2013-12-09 15:41:44,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42e5c0fe >2013-12-09 15:41:44,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42e5c0fe >2013-12-09 15:41:49,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d80619f >2013-12-09 15:41:50,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: d80619f >2013-12-09 15:41:50,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f02fe1a >2013-12-09 15:41:50,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f02fe1a >2013-12-09 15:41:55,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 147cc159 >2013-12-09 15:41:56,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 147cc159 >2013-12-09 15:41:56,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 222d3466 >2013-12-09 15:41:56,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 222d3466 >2013-12-09 15:42:01,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 22d5f3e3 >2013-12-09 15:42:01,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 22d5f3e3 >2013-12-09 15:42:01,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35257350 >2013-12-09 15:42:02,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35257350 >2013-12-09 15:42:07,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f0a4425 >2013-12-09 15:42:07,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f0a4425 >2013-12-09 15:42:07,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 339666df >2013-12-09 15:42:07,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 339666df >2013-12-09 15:42:12,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d2f3e57 >2013-12-09 15:42:13,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d2f3e57 >2013-12-09 15:42:13,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50acfaa6 >2013-12-09 15:42:13,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50acfaa6 >2013-12-09 15:42:18,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 614e304d >2013-12-09 15:42:19,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 614e304d >2013-12-09 15:42:19,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5fbd5558 >2013-12-09 15:42:19,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fbd5558 >2013-12-09 15:42:22,554 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-37) No up server in cluster >2013-12-09 15:42:22,555 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-37) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:42:22,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 22f93595 >2013-12-09 15:42:22,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterTasksListVDSCommand, return: [], log id: 22f93595 >2013-12-09 15:42:24,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 789967c5 >2013-12-09 15:42:25,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 789967c5 >2013-12-09 15:42:25,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 625cb99 >2013-12-09 15:42:25,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 625cb99 >2013-12-09 15:42:30,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24713ef4 >2013-12-09 15:42:30,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 24713ef4 >2013-12-09 15:42:30,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21786c64 >2013-12-09 15:42:31,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21786c64 >2013-12-09 15:42:36,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d55a269 >2013-12-09 15:42:36,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d55a269 >2013-12-09 15:42:36,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1efab147 >2013-12-09 15:42:36,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1efab147 >2013-12-09 15:42:41,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19c8486e >2013-12-09 15:42:42,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 19c8486e >2013-12-09 15:42:42,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f0bde7 >2013-12-09 15:42:42,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f0bde7 >2013-12-09 15:42:47,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47449c6d >2013-12-09 15:42:48,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 47449c6d >2013-12-09 15:42:48,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2585dc84 >2013-12-09 15:42:48,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2585dc84 >2013-12-09 15:42:53,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3625859a >2013-12-09 15:42:53,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3625859a >2013-12-09 15:42:53,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ea3db6c >2013-12-09 15:42:54,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ea3db6c >2013-12-09 15:42:59,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13ebac16 >2013-12-09 15:42:59,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 13ebac16 >2013-12-09 15:42:59,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3749bb3a >2013-12-09 15:42:59,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3749bb3a >2013-12-09 15:43:04,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d6f01c5 >2013-12-09 15:43:05,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6d6f01c5 >2013-12-09 15:43:05,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 596badc8 >2013-12-09 15:43:05,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 596badc8 >2013-12-09 15:43:10,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8405a83 >2013-12-09 15:43:11,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 8405a83 >2013-12-09 15:43:11,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34eeb773 >2013-12-09 15:43:11,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34eeb773 >2013-12-09 15:43:16,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14614bbd >2013-12-09 15:43:17,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 14614bbd >2013-12-09 15:43:17,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f4f954e >2013-12-09 15:43:17,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f4f954e >2013-12-09 15:43:22,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9b29714 >2013-12-09 15:43:22,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 9b29714 >2013-12-09 15:43:22,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14562a60 >2013-12-09 15:43:22,834 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-74) No up server in cluster >2013-12-09 15:43:22,834 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-74) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:43:22,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 530deaac >2013-12-09 15:43:23,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14562a60 >2013-12-09 15:43:23,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterTasksListVDSCommand, return: [], log id: 530deaac >2013-12-09 15:43:28,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 334c39ca >2013-12-09 15:43:28,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 334c39ca >2013-12-09 15:43:28,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2834da90 >2013-12-09 15:43:28,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2834da90 >2013-12-09 15:43:33,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a0a4738 >2013-12-09 15:43:34,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a0a4738 >2013-12-09 15:43:34,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1931baca >2013-12-09 15:43:34,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1931baca >2013-12-09 15:43:39,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45cb753d >2013-12-09 15:43:40,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 45cb753d >2013-12-09 15:43:40,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6357cd5e >2013-12-09 15:43:40,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6357cd5e >2013-12-09 15:43:45,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2af0262e >2013-12-09 15:43:45,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2af0262e >2013-12-09 15:43:45,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b1f0e3 >2013-12-09 15:43:46,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b1f0e3 >2013-12-09 15:43:51,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49474eb8 >2013-12-09 15:43:51,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 49474eb8 >2013-12-09 15:43:51,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 620bbe5a >2013-12-09 15:43:51,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 620bbe5a >2013-12-09 15:43:56,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55551bed >2013-12-09 15:43:57,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 55551bed >2013-12-09 15:43:57,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d9f9229 >2013-12-09 15:43:57,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d9f9229 >2013-12-09 15:44:02,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7aacbf26 >2013-12-09 15:44:03,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7aacbf26 >2013-12-09 15:44:03,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29f3e198 >2013-12-09 15:44:03,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29f3e198 >2013-12-09 15:44:08,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 502cfbfe >2013-12-09 15:44:08,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 502cfbfe >2013-12-09 15:44:08,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c3737e3 >2013-12-09 15:44:09,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c3737e3 >2013-12-09 15:44:14,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6abd676f >2013-12-09 15:44:14,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6abd676f >2013-12-09 15:44:14,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5076b4cf >2013-12-09 15:44:15,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5076b4cf >2013-12-09 15:44:20,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ae98509 >2013-12-09 15:44:20,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1ae98509 >2013-12-09 15:44:20,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ab675dc >2013-12-09 15:44:20,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ab675dc >2013-12-09 15:44:23,092 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-43) No up server in cluster >2013-12-09 15:44:23,092 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-43) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:44:23,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49f3788b >2013-12-09 15:44:23,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterTasksListVDSCommand, return: [], log id: 49f3788b >2013-12-09 15:44:25,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a4bc49f >2013-12-09 15:44:26,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a4bc49f >2013-12-09 15:44:26,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a236386 >2013-12-09 15:44:26,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a236386 >2013-12-09 15:44:31,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 760f3bf5 >2013-12-09 15:44:32,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 760f3bf5 >2013-12-09 15:44:32,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79d24deb >2013-12-09 15:44:32,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79d24deb >2013-12-09 15:44:37,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46124337 >2013-12-09 15:44:37,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 46124337 >2013-12-09 15:44:37,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e45d7c9 >2013-12-09 15:44:38,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e45d7c9 >2013-12-09 15:44:43,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43393f45 >2013-12-09 15:44:43,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 43393f45 >2013-12-09 15:44:43,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 773e782e >2013-12-09 15:44:43,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 773e782e >2013-12-09 15:44:48,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 118006ee >2013-12-09 15:44:49,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 118006ee >2013-12-09 15:44:49,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 667140a6 >2013-12-09 15:44:49,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 667140a6 >2013-12-09 15:44:54,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76e6c2ac >2013-12-09 15:44:55,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 76e6c2ac >2013-12-09 15:44:55,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77c62260 >2013-12-09 15:44:55,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77c62260 >2013-12-09 15:45:00,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 414e40b >2013-12-09 15:45:01,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 414e40b >2013-12-09 15:45:01,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1cd8c0a2 >2013-12-09 15:45:01,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1cd8c0a2 >2013-12-09 15:45:06,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ae1eae8 >2013-12-09 15:45:06,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2ae1eae8 >2013-12-09 15:45:06,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a544311 >2013-12-09 15:45:07,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a544311 >2013-12-09 15:45:12,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5639f526 >2013-12-09 15:45:12,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5639f526 >2013-12-09 15:45:12,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d7df197 >2013-12-09 15:45:12,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d7df197 >2013-12-09 15:45:17,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b5da37f >2013-12-09 15:45:18,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b5da37f >2013-12-09 15:45:18,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d07911e >2013-12-09 15:45:18,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d07911e >2013-12-09 15:45:23,377 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-83) No up server in cluster >2013-12-09 15:45:23,377 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-83) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:45:23,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 780d0ad1 >2013-12-09 15:45:23,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3386269e >2013-12-09 15:45:23,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterTasksListVDSCommand, return: [], log id: 780d0ad1 >2013-12-09 15:45:24,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3386269e >2013-12-09 15:45:24,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3353e9d9 >2013-12-09 15:45:24,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3353e9d9 >2013-12-09 15:45:29,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 331c7c67 >2013-12-09 15:45:29,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 331c7c67 >2013-12-09 15:45:29,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e2949bf >2013-12-09 15:45:30,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e2949bf >2013-12-09 15:45:35,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a11cba >2013-12-09 15:45:35,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a11cba >2013-12-09 15:45:35,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53aad076 >2013-12-09 15:45:35,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53aad076 >2013-12-09 15:45:40,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 596c450f >2013-12-09 15:45:41,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 596c450f >2013-12-09 15:45:41,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ad28104 >2013-12-09 15:45:41,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ad28104 >2013-12-09 15:45:46,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4224f7be >2013-12-09 15:45:47,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4224f7be >2013-12-09 15:45:47,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e889c0f >2013-12-09 15:45:47,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e889c0f >2013-12-09 15:45:52,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12087727 >2013-12-09 15:45:53,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 12087727 >2013-12-09 15:45:53,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 153f6cf5 >2013-12-09 15:45:53,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 153f6cf5 >2013-12-09 15:45:58,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30b7ef5f >2013-12-09 15:45:58,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 30b7ef5f >2013-12-09 15:45:58,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76a54e2 >2013-12-09 15:45:59,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76a54e2 >2013-12-09 15:46:04,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8de4a69 >2013-12-09 15:46:04,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 8de4a69 >2013-12-09 15:46:04,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26940bde >2013-12-09 15:46:04,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26940bde >2013-12-09 15:46:09,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: fb7d1f6 >2013-12-09 15:46:10,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: fb7d1f6 >2013-12-09 15:46:10,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3db083d >2013-12-09 15:46:10,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3db083d >2013-12-09 15:46:15,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46e4e646 >2013-12-09 15:46:16,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 46e4e646 >2013-12-09 15:46:16,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3bb5f58f >2013-12-09 15:46:16,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3bb5f58f >2013-12-09 15:46:21,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23979528 >2013-12-09 15:46:22,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 23979528 >2013-12-09 15:46:22,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e9390d7 >2013-12-09 15:46:22,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e9390d7 >2013-12-09 15:46:23,661 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-81) No up server in cluster >2013-12-09 15:46:23,661 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-81) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:46:23,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69d594b6 >2013-12-09 15:46:23,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterTasksListVDSCommand, return: [], log id: 69d594b6 >2013-12-09 15:46:27,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 428dcc26 >2013-12-09 15:46:27,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 428dcc26 >2013-12-09 15:46:27,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 493ea154 >2013-12-09 15:46:28,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 493ea154 >2013-12-09 15:46:33,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51cf1e6e >2013-12-09 15:46:33,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 51cf1e6e >2013-12-09 15:46:33,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 521935a7 >2013-12-09 15:46:33,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 521935a7 >2013-12-09 15:46:38,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4fc9675e >2013-12-09 15:46:39,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4fc9675e >2013-12-09 15:46:39,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f58936e >2013-12-09 15:46:39,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f58936e >2013-12-09 15:46:44,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4763086a >2013-12-09 15:46:45,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4763086a >2013-12-09 15:46:45,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 718cbafd >2013-12-09 15:46:45,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 718cbafd >2013-12-09 15:46:50,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6503c678 >2013-12-09 15:46:50,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6503c678 >2013-12-09 15:46:50,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 184b0480 >2013-12-09 15:46:51,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 184b0480 >2013-12-09 15:46:56,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78dd492d >2013-12-09 15:46:56,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 78dd492d >2013-12-09 15:46:56,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c805027 >2013-12-09 15:46:57,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c805027 >2013-12-09 15:47:02,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3100777e >2013-12-09 15:47:02,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3100777e >2013-12-09 15:47:02,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b87223c >2013-12-09 15:47:02,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b87223c >2013-12-09 15:47:07,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56b9ad2a >2013-12-09 15:47:08,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 56b9ad2a >2013-12-09 15:47:08,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42857d6f >2013-12-09 15:47:08,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42857d6f >2013-12-09 15:47:13,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55aad822 >2013-12-09 15:47:14,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 55aad822 >2013-12-09 15:47:14,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d70db31 >2013-12-09 15:47:14,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d70db31 >2013-12-09 15:47:19,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e6f7620 >2013-12-09 15:47:19,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3e6f7620 >2013-12-09 15:47:19,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c3aa85a >2013-12-09 15:47:20,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c3aa85a >2013-12-09 15:47:23,930 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-31) No up server in cluster >2013-12-09 15:47:23,930 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-31) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:47:23,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69ab2e42 >2013-12-09 15:47:24,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterTasksListVDSCommand, return: [], log id: 69ab2e42 >2013-12-09 15:47:25,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d077b94 >2013-12-09 15:47:25,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4d077b94 >2013-12-09 15:47:25,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16e1fcc4 >2013-12-09 15:47:25,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16e1fcc4 >2013-12-09 15:47:30,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f0432ef >2013-12-09 15:47:31,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f0432ef >2013-12-09 15:47:31,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4791a2ed >2013-12-09 15:47:31,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4791a2ed >2013-12-09 15:47:36,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f80b00d >2013-12-09 15:47:37,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f80b00d >2013-12-09 15:47:37,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d53ab71 >2013-12-09 15:47:37,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d53ab71 >2013-12-09 15:47:42,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e37ed75 >2013-12-09 15:47:43,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3e37ed75 >2013-12-09 15:47:43,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7088c286 >2013-12-09 15:47:43,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7088c286 >2013-12-09 15:47:48,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c462015 >2013-12-09 15:47:48,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c462015 >2013-12-09 15:47:48,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25807503 >2013-12-09 15:47:49,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25807503 >2013-12-09 15:47:54,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 432400e0 >2013-12-09 15:47:54,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 432400e0 >2013-12-09 15:47:54,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30194493 >2013-12-09 15:47:54,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30194493 >2013-12-09 15:47:59,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c2d3caa >2013-12-09 15:48:00,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c2d3caa >2013-12-09 15:48:00,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69b51183 >2013-12-09 15:48:00,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69b51183 >2013-12-09 15:48:05,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5de429a4 >2013-12-09 15:48:06,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5de429a4 >2013-12-09 15:48:06,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a4d858d >2013-12-09 15:48:06,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a4d858d >2013-12-09 15:48:11,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ec45549 >2013-12-09 15:48:11,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ec45549 >2013-12-09 15:48:11,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1dc64072 >2013-12-09 15:48:12,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1dc64072 >2013-12-09 15:48:17,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4663d08c >2013-12-09 15:48:17,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4663d08c >2013-12-09 15:48:17,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ac2e83f >2013-12-09 15:48:17,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ac2e83f >2013-12-09 15:48:22,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76ce045c >2013-12-09 15:48:23,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 76ce045c >2013-12-09 15:48:23,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 720483ad >2013-12-09 15:48:23,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 720483ad >2013-12-09 15:48:24,218 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-59) No up server in cluster >2013-12-09 15:48:24,218 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-59) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:48:24,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c78d960 >2013-12-09 15:48:24,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterTasksListVDSCommand, return: [], log id: c78d960 >2013-12-09 15:48:28,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40e541d5 >2013-12-09 15:48:29,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 40e541d5 >2013-12-09 15:48:29,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4bd631de >2013-12-09 15:48:29,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4bd631de >2013-12-09 15:48:34,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12fd0ac2 >2013-12-09 15:48:35,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 12fd0ac2 >2013-12-09 15:48:35,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6aec4c31 >2013-12-09 15:48:35,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6aec4c31 >2013-12-09 15:48:40,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ec98059 >2013-12-09 15:48:40,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: ec98059 >2013-12-09 15:48:40,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20915fd4 >2013-12-09 15:48:41,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20915fd4 >2013-12-09 15:48:46,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27ef023f >2013-12-09 15:48:46,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 27ef023f >2013-12-09 15:48:46,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e29f9c9 >2013-12-09 15:48:46,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e29f9c9 >2013-12-09 15:48:51,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14326690 >2013-12-09 15:48:52,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 14326690 >2013-12-09 15:48:52,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 13e3d5eb >2013-12-09 15:48:52,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13e3d5eb >2013-12-09 15:48:57,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 451ce698 >2013-12-09 15:48:58,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 451ce698 >2013-12-09 15:48:58,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f452973 >2013-12-09 15:48:58,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f452973 >2013-12-09 15:49:03,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1114bca6 >2013-12-09 15:49:03,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1114bca6 >2013-12-09 15:49:03,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a7e8075 >2013-12-09 15:49:04,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a7e8075 >2013-12-09 15:49:09,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38da0bdb >2013-12-09 15:49:09,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 38da0bdb >2013-12-09 15:49:09,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c348d2d >2013-12-09 15:49:09,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c348d2d >2013-12-09 15:49:14,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53bbfe73 >2013-12-09 15:49:15,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 53bbfe73 >2013-12-09 15:49:15,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 647566d4 >2013-12-09 15:49:15,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 647566d4 >2013-12-09 15:49:20,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1bef8a5a >2013-12-09 15:49:21,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1bef8a5a >2013-12-09 15:49:21,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ca2abe1 >2013-12-09 15:49:21,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ca2abe1 >2013-12-09 15:49:24,521 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-16) No up server in cluster >2013-12-09 15:49:24,521 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-16) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:49:24,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c7a2257 >2013-12-09 15:49:24,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3c7a2257 >2013-12-09 15:49:26,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 673f3325 >2013-12-09 15:49:27,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 673f3325 >2013-12-09 15:49:27,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6204041f >2013-12-09 15:49:27,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6204041f >2013-12-09 15:49:32,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50e00c8f >2013-12-09 15:49:32,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 50e00c8f >2013-12-09 15:49:32,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78c986ee >2013-12-09 15:49:33,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78c986ee >2013-12-09 15:49:38,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4178ce37 >2013-12-09 15:49:38,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4178ce37 >2013-12-09 15:49:38,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56ede36a >2013-12-09 15:49:38,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56ede36a >2013-12-09 15:49:43,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: aa364db >2013-12-09 15:49:44,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: aa364db >2013-12-09 15:49:44,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e07af41 >2013-12-09 15:49:44,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e07af41 >2013-12-09 15:49:49,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d1b776e >2013-12-09 15:49:50,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2d1b776e >2013-12-09 15:49:50,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 321743f9 >2013-12-09 15:49:50,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 321743f9 >2013-12-09 15:49:55,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 674ff1bd >2013-12-09 15:49:55,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 674ff1bd >2013-12-09 15:49:55,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c18dd56 >2013-12-09 15:49:56,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c18dd56 >2013-12-09 15:50:01,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b5dc11e >2013-12-09 15:50:01,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: b5dc11e >2013-12-09 15:50:01,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 160f4811 >2013-12-09 15:50:01,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 160f4811 >2013-12-09 15:50:06,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6aadb26b >2013-12-09 15:50:07,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6aadb26b >2013-12-09 15:50:07,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a4a8431 >2013-12-09 15:50:07,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a4a8431 >2013-12-09 15:50:12,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36819952 >2013-12-09 15:50:13,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 36819952 >2013-12-09 15:50:13,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74daba15 >2013-12-09 15:50:13,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74daba15 >2013-12-09 15:50:18,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59b8721c >2013-12-09 15:50:19,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59b8721c >2013-12-09 15:50:19,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f9e5ad2 >2013-12-09 15:50:19,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f9e5ad2 >2013-12-09 15:50:24,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1efb3b53 >2013-12-09 15:50:24,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1efb3b53 >2013-12-09 15:50:24,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 719f680c >2013-12-09 15:50:24,816 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) No up server in cluster >2013-12-09 15:50:24,816 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:50:24,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b445f02 >2013-12-09 15:50:25,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 719f680c >2013-12-09 15:50:25,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7b445f02 >2013-12-09 15:50:30,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37298deb >2013-12-09 15:50:30,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 37298deb >2013-12-09 15:50:30,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18d2acb8 >2013-12-09 15:50:30,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18d2acb8 >2013-12-09 15:50:35,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: cf81d07 >2013-12-09 15:50:36,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: cf81d07 >2013-12-09 15:50:36,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72b7c00e >2013-12-09 15:50:36,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72b7c00e >2013-12-09 15:50:41,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 286d6a1 >2013-12-09 15:50:42,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 286d6a1 >2013-12-09 15:50:42,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36d629fe >2013-12-09 15:50:42,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36d629fe >2013-12-09 15:50:47,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a83e697 >2013-12-09 15:50:47,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3a83e697 >2013-12-09 15:50:47,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 174dad19 >2013-12-09 15:50:48,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 174dad19 >2013-12-09 15:50:53,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 247a1fb3 >2013-12-09 15:50:53,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 247a1fb3 >2013-12-09 15:50:53,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f9b72de >2013-12-09 15:50:53,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f9b72de >2013-12-09 15:50:58,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1dcd22b9 >2013-12-09 15:50:59,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1dcd22b9 >2013-12-09 15:50:59,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 49d3bc2 >2013-12-09 15:50:59,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49d3bc2 >2013-12-09 15:51:04,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 119e2d3 >2013-12-09 15:51:05,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 119e2d3 >2013-12-09 15:51:05,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2187ff8b >2013-12-09 15:51:05,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2187ff8b >2013-12-09 15:51:10,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6dd4fdd8 >2013-12-09 15:51:11,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6dd4fdd8 >2013-12-09 15:51:11,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 125c85f8 >2013-12-09 15:51:11,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 125c85f8 >2013-12-09 15:51:16,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a2390b >2013-12-09 15:51:16,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: a2390b >2013-12-09 15:51:16,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6252f535 >2013-12-09 15:51:17,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6252f535 >2013-12-09 15:51:22,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1217197d >2013-12-09 15:51:22,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1217197d >2013-12-09 15:51:22,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d55467f >2013-12-09 15:51:22,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d55467f >2013-12-09 15:51:25,060 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) No up server in cluster >2013-12-09 15:51:25,060 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:51:25,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6df664ec >2013-12-09 15:51:25,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6df664ec >2013-12-09 15:51:27,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 425df460 >2013-12-09 15:51:28,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 425df460 >2013-12-09 15:51:28,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 599c64ad >2013-12-09 15:51:28,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 599c64ad >2013-12-09 15:51:33,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74b519e4 >2013-12-09 15:51:34,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 74b519e4 >2013-12-09 15:51:34,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6e06439b >2013-12-09 15:51:34,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e06439b >2013-12-09 15:51:39,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c97d308 >2013-12-09 15:51:39,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4c97d308 >2013-12-09 15:51:39,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78477fa6 >2013-12-09 15:51:40,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78477fa6 >2013-12-09 15:51:45,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 70c99801 >2013-12-09 15:51:45,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 70c99801 >2013-12-09 15:51:45,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6091a979 >2013-12-09 15:51:45,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6091a979 >2013-12-09 15:51:50,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7715a3ae >2013-12-09 15:51:51,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7715a3ae >2013-12-09 15:51:51,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 53db125c >2013-12-09 15:51:51,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53db125c >2013-12-09 15:51:56,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11b22d90 >2013-12-09 15:51:57,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 11b22d90 >2013-12-09 15:51:57,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a391398 >2013-12-09 15:51:57,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a391398 >2013-12-09 15:52:02,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21d85376 >2013-12-09 15:52:02,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 21d85376 >2013-12-09 15:52:02,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 996e64 >2013-12-09 15:52:03,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 996e64 >2013-12-09 15:52:08,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c1ee6a >2013-12-09 15:52:08,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4c1ee6a >2013-12-09 15:52:08,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c68c22a >2013-12-09 15:52:09,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c68c22a >2013-12-09 15:52:14,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5916558 >2013-12-09 15:52:14,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5916558 >2013-12-09 15:52:14,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4be52a29 >2013-12-09 15:52:14,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4be52a29 >2013-12-09 15:52:19,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f3dbf5b >2013-12-09 15:52:20,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f3dbf5b >2013-12-09 15:52:20,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79ecec0c >2013-12-09 15:52:20,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79ecec0c >2013-12-09 15:52:25,336 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-15) No up server in cluster >2013-12-09 15:52:25,336 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-15) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:52:25,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6750f5f9 >2013-12-09 15:52:25,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1586a8e6 >2013-12-09 15:52:25,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6750f5f9 >2013-12-09 15:52:26,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1586a8e6 >2013-12-09 15:52:26,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f9c0c8e >2013-12-09 15:52:26,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f9c0c8e >2013-12-09 15:52:31,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d96731 >2013-12-09 15:52:31,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d96731 >2013-12-09 15:52:31,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73fdda59 >2013-12-09 15:52:32,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73fdda59 >2013-12-09 15:52:37,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 719644ca >2013-12-09 15:52:37,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 719644ca >2013-12-09 15:52:37,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64d9190f >2013-12-09 15:52:37,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64d9190f >2013-12-09 15:52:42,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59425d19 >2013-12-09 15:52:43,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 59425d19 >2013-12-09 15:52:43,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b7457ff >2013-12-09 15:52:43,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b7457ff >2013-12-09 15:52:48,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 214d5d0f >2013-12-09 15:52:49,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 214d5d0f >2013-12-09 15:52:49,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1edb8f0e >2013-12-09 15:52:49,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1edb8f0e >2013-12-09 15:52:54,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 466676db >2013-12-09 15:52:54,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 466676db >2013-12-09 15:52:54,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c4ebdb1 >2013-12-09 15:52:55,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c4ebdb1 >2013-12-09 15:53:00,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69cc289f >2013-12-09 15:53:00,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 69cc289f >2013-12-09 15:53:00,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21edc79f >2013-12-09 15:53:01,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21edc79f >2013-12-09 15:53:06,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b4f225d >2013-12-09 15:53:06,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1b4f225d >2013-12-09 15:53:06,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 142bb8c5 >2013-12-09 15:53:06,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 142bb8c5 >2013-12-09 15:53:11,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 728e9c15 >2013-12-09 15:53:12,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 728e9c15 >2013-12-09 15:53:12,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5adca5fe >2013-12-09 15:53:12,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5adca5fe >2013-12-09 15:53:17,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 77ae6a32 >2013-12-09 15:53:18,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 77ae6a32 >2013-12-09 15:53:18,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f043b42 >2013-12-09 15:53:18,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f043b42 >2013-12-09 15:53:23,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4cdff3e >2013-12-09 15:53:23,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4cdff3e >2013-12-09 15:53:23,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 428690a >2013-12-09 15:53:24,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 428690a >2013-12-09 15:53:25,628 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-2) No up server in cluster >2013-12-09 15:53:25,628 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-2) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:53:25,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a77c1b7 >2013-12-09 15:53:25,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterTasksListVDSCommand, return: [], log id: a77c1b7 >2013-12-09 15:53:29,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 25813f2c >2013-12-09 15:53:29,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 25813f2c >2013-12-09 15:53:29,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c1ae7d2 >2013-12-09 15:53:29,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c1ae7d2 >2013-12-09 15:53:34,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ce235ea >2013-12-09 15:53:35,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ce235ea >2013-12-09 15:53:35,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40a6b1ec >2013-12-09 15:53:35,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40a6b1ec >2013-12-09 15:53:40,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71230de9 >2013-12-09 15:53:41,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 71230de9 >2013-12-09 15:53:41,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2893ddda >2013-12-09 15:53:41,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2893ddda >2013-12-09 15:53:46,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1aa17bf5 >2013-12-09 15:53:46,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1aa17bf5 >2013-12-09 15:53:46,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d5a5dba >2013-12-09 15:53:47,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d5a5dba >2013-12-09 15:53:52,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 293a0643 >2013-12-09 15:53:52,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 293a0643 >2013-12-09 15:53:52,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ba32d69 >2013-12-09 15:53:53,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ba32d69 >2013-12-09 15:53:58,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 31391278 >2013-12-09 15:53:58,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 31391278 >2013-12-09 15:53:58,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 277b7341 >2013-12-09 15:53:58,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 277b7341 >2013-12-09 15:54:03,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 423ad390 >2013-12-09 15:54:04,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 423ad390 >2013-12-09 15:54:04,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4dcba987 >2013-12-09 15:54:04,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4dcba987 >2013-12-09 15:54:09,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49a2ed87 >2013-12-09 15:54:10,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 49a2ed87 >2013-12-09 15:54:10,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 620761a8 >2013-12-09 15:54:10,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 620761a8 >2013-12-09 15:54:15,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7adbb720 >2013-12-09 15:54:15,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7adbb720 >2013-12-09 15:54:15,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30512bf6 >2013-12-09 15:54:16,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30512bf6 >2013-12-09 15:54:21,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4bc21eb5 >2013-12-09 15:54:21,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4bc21eb5 >2013-12-09 15:54:21,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67a19c40 >2013-12-09 15:54:21,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67a19c40 >2013-12-09 15:54:25,916 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-97) No up server in cluster >2013-12-09 15:54:25,916 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-97) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:54:25,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a2593a >2013-12-09 15:54:26,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterTasksListVDSCommand, return: [], log id: a2593a >2013-12-09 15:54:26,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6eab5fab >2013-12-09 15:54:27,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6eab5fab >2013-12-09 15:54:27,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 250794ab >2013-12-09 15:54:27,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 250794ab >2013-12-09 15:54:32,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2574d4fc >2013-12-09 15:54:33,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2574d4fc >2013-12-09 15:54:33,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4fea9cc1 >2013-12-09 15:54:33,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fea9cc1 >2013-12-09 15:54:38,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3422b197 >2013-12-09 15:54:39,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3422b197 >2013-12-09 15:54:39,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28a36068 >2013-12-09 15:54:39,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28a36068 >2013-12-09 15:54:44,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ead201e >2013-12-09 15:54:44,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7ead201e >2013-12-09 15:54:44,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a3266f5 >2013-12-09 15:54:45,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a3266f5 >2013-12-09 15:54:50,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14081c67 >2013-12-09 15:54:50,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 14081c67 >2013-12-09 15:54:50,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2fefba4e >2013-12-09 15:54:50,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2fefba4e >2013-12-09 15:54:55,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f94ecf1 >2013-12-09 15:54:56,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f94ecf1 >2013-12-09 15:54:56,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2db8f514 >2013-12-09 15:54:56,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2db8f514 >2013-12-09 15:55:01,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ff8444c >2013-12-09 15:55:02,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4ff8444c >2013-12-09 15:55:02,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ebf7012 >2013-12-09 15:55:02,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ebf7012 >2013-12-09 15:55:07,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67632334 >2013-12-09 15:55:07,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 67632334 >2013-12-09 15:55:07,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8e1e94d >2013-12-09 15:55:08,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8e1e94d >2013-12-09 15:55:13,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 381413e0 >2013-12-09 15:55:13,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 381413e0 >2013-12-09 15:55:13,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e440076 >2013-12-09 15:55:13,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e440076 >2013-12-09 15:55:19,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 502b0f07 >2013-12-09 15:55:19,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 502b0f07 >2013-12-09 15:55:19,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 759a62f0 >2013-12-09 15:55:19,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 759a62f0 >2013-12-09 15:55:24,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: bdcb9e7 >2013-12-09 15:55:25,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: bdcb9e7 >2013-12-09 15:55:25,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 85dee84 >2013-12-09 15:55:25,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 85dee84 >2013-12-09 15:55:26,205 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-100) No up server in cluster >2013-12-09 15:55:26,205 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-100) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:55:26,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14efc4db >2013-12-09 15:55:26,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterTasksListVDSCommand, return: [], log id: 14efc4db >2013-12-09 15:55:30,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d3fccd8 >2013-12-09 15:55:31,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6d3fccd8 >2013-12-09 15:55:31,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ec70d0a >2013-12-09 15:55:31,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ec70d0a >2013-12-09 15:55:36,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2123609a >2013-12-09 15:55:36,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2123609a >2013-12-09 15:55:36,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1cc7d092 >2013-12-09 15:55:37,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1cc7d092 >2013-12-09 15:55:42,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d43d23 >2013-12-09 15:55:42,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: d43d23 >2013-12-09 15:55:42,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: fd5053 >2013-12-09 15:55:42,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: fd5053 >2013-12-09 15:55:47,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25421980 >2013-12-09 15:55:48,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 25421980 >2013-12-09 15:55:48,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 361add26 >2013-12-09 15:55:48,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 361add26 >2013-12-09 15:55:53,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c6dc029 >2013-12-09 15:55:54,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4c6dc029 >2013-12-09 15:55:54,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 559554d2 >2013-12-09 15:55:54,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 559554d2 >2013-12-09 15:55:59,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ced8e74 >2013-12-09 15:55:59,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6ced8e74 >2013-12-09 15:55:59,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 223d2030 >2013-12-09 15:56:00,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 223d2030 >2013-12-09 15:56:05,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 238bb7d6 >2013-12-09 15:56:05,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 238bb7d6 >2013-12-09 15:56:05,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7fce7dc >2013-12-09 15:56:06,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fce7dc >2013-12-09 15:56:11,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ce66389 >2013-12-09 15:56:11,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ce66389 >2013-12-09 15:56:11,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20e16ec9 >2013-12-09 15:56:11,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20e16ec9 >2013-12-09 15:56:16,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 510cb22 >2013-12-09 15:56:17,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 510cb22 >2013-12-09 15:56:17,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3dbdbbc3 >2013-12-09 15:56:17,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3dbdbbc3 >2013-12-09 15:56:22,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5da0870b >2013-12-09 15:56:23,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5da0870b >2013-12-09 15:56:23,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 22f400ae >2013-12-09 15:56:23,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22f400ae >2013-12-09 15:56:26,475 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-32) No up server in cluster >2013-12-09 15:56:26,475 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-32) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:56:26,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4e5609a6 >2013-12-09 15:56:26,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4e5609a6 >2013-12-09 15:56:28,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e3146d8 >2013-12-09 15:56:28,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3e3146d8 >2013-12-09 15:56:28,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e6f300e >2013-12-09 15:56:29,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e6f300e >2013-12-09 15:56:34,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1fab5279 >2013-12-09 15:56:34,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1fab5279 >2013-12-09 15:56:34,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65ef8da3 >2013-12-09 15:56:34,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65ef8da3 >2013-12-09 15:56:39,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 481f09ab >2013-12-09 15:56:40,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 481f09ab >2013-12-09 15:56:40,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f71d99d >2013-12-09 15:56:40,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f71d99d >2013-12-09 15:56:45,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 220468c1 >2013-12-09 15:56:46,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 220468c1 >2013-12-09 15:56:46,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30641cab >2013-12-09 15:56:46,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30641cab >2013-12-09 15:56:51,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 263945a5 >2013-12-09 15:56:51,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 263945a5 >2013-12-09 15:56:51,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58bec00a >2013-12-09 15:56:52,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58bec00a >2013-12-09 15:56:57,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25b16039 >2013-12-09 15:56:57,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 25b16039 >2013-12-09 15:56:57,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 660aa3c4 >2013-12-09 15:56:57,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 660aa3c4 >2013-12-09 15:57:02,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71e4f0f9 >2013-12-09 15:57:03,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 71e4f0f9 >2013-12-09 15:57:03,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20a7de7f >2013-12-09 15:57:03,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20a7de7f >2013-12-09 15:57:08,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ee74770 >2013-12-09 15:57:09,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2ee74770 >2013-12-09 15:57:09,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2bdf9be3 >2013-12-09 15:57:09,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bdf9be3 >2013-12-09 15:57:14,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4533e881 >2013-12-09 15:57:15,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4533e881 >2013-12-09 15:57:15,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2448b2f3 >2013-12-09 15:57:15,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2448b2f3 >2013-12-09 15:57:20,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58aa0bf8 >2013-12-09 15:57:20,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 58aa0bf8 >2013-12-09 15:57:20,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19152d93 >2013-12-09 15:57:21,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19152d93 >2013-12-09 15:57:26,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17b45423 >2013-12-09 15:57:26,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 17b45423 >2013-12-09 15:57:26,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46f20b45 >2013-12-09 15:57:26,756 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-6) No up server in cluster >2013-12-09 15:57:26,757 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-6) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:57:26,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 362e0b35 >2013-12-09 15:57:26,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46f20b45 >2013-12-09 15:57:27,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterTasksListVDSCommand, return: [], log id: 362e0b35 >2013-12-09 15:57:31,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e983d32 >2013-12-09 15:57:32,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5e983d32 >2013-12-09 15:57:32,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f31ef2b >2013-12-09 15:57:32,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f31ef2b >2013-12-09 15:57:37,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 540eb6ac >2013-12-09 15:57:38,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 540eb6ac >2013-12-09 15:57:38,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c09053d >2013-12-09 15:57:38,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c09053d >2013-12-09 15:57:43,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b8d6e6e >2013-12-09 15:57:43,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: b8d6e6e >2013-12-09 15:57:43,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a883959 >2013-12-09 15:57:44,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a883959 >2013-12-09 15:57:49,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f44faf5 >2013-12-09 15:57:49,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f44faf5 >2013-12-09 15:57:49,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a9485a9 >2013-12-09 15:57:49,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a9485a9 >2013-12-09 15:57:55,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6620119 >2013-12-09 15:57:55,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6620119 >2013-12-09 15:57:55,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c7a0352 >2013-12-09 15:57:55,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c7a0352 >2013-12-09 15:58:00,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b10b246 >2013-12-09 15:58:01,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4b10b246 >2013-12-09 15:58:01,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46664c4b >2013-12-09 15:58:01,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46664c4b >2013-12-09 15:58:06,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 144420a3 >2013-12-09 15:58:07,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 144420a3 >2013-12-09 15:58:07,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 956b934 >2013-12-09 15:58:07,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 956b934 >2013-12-09 15:58:12,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 167a1c71 >2013-12-09 15:58:12,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 167a1c71 >2013-12-09 15:58:12,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28113f58 >2013-12-09 15:58:13,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28113f58 >2013-12-09 15:58:18,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7dea22a9 >2013-12-09 15:58:18,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7dea22a9 >2013-12-09 15:58:18,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20b2dd65 >2013-12-09 15:58:18,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20b2dd65 >2013-12-09 15:58:23,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4843abc >2013-12-09 15:58:24,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4843abc >2013-12-09 15:58:24,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 241f8b97 >2013-12-09 15:58:24,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 241f8b97 >2013-12-09 15:58:27,011 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-48) No up server in cluster >2013-12-09 15:58:27,011 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-48) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:58:27,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6bdc1693 >2013-12-09 15:58:27,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6bdc1693 >2013-12-09 15:58:29,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38a9b689 >2013-12-09 15:58:30,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 38a9b689 >2013-12-09 15:58:30,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a06e42 >2013-12-09 15:58:30,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a06e42 >2013-12-09 15:58:35,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b1ed5d7 >2013-12-09 15:58:36,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b1ed5d7 >2013-12-09 15:58:36,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: aa7996e >2013-12-09 15:58:36,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: aa7996e >2013-12-09 15:58:41,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ef735de >2013-12-09 15:58:41,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5ef735de >2013-12-09 15:58:41,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d8ad764 >2013-12-09 15:58:42,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d8ad764 >2013-12-09 15:58:47,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5d70949c >2013-12-09 15:58:47,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5d70949c >2013-12-09 15:58:47,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c758877 >2013-12-09 15:58:47,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c758877 >2013-12-09 15:58:52,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 73ddcbd6 >2013-12-09 15:58:53,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 73ddcbd6 >2013-12-09 15:58:53,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c4a52f1 >2013-12-09 15:58:53,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c4a52f1 >2013-12-09 15:58:58,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e47624a >2013-12-09 15:58:59,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: e47624a >2013-12-09 15:58:59,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38b273cc >2013-12-09 15:58:59,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38b273cc >2013-12-09 15:59:04,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b1a939b >2013-12-09 15:59:04,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1b1a939b >2013-12-09 15:59:04,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34815bfc >2013-12-09 15:59:05,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34815bfc >2013-12-09 15:59:10,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3dade33e >2013-12-09 15:59:10,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3dade33e >2013-12-09 15:59:10,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9c346ed >2013-12-09 15:59:10,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9c346ed >2013-12-09 15:59:15,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6fa61b7 >2013-12-09 15:59:16,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6fa61b7 >2013-12-09 15:59:16,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 111dd5e8 >2013-12-09 15:59:16,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 111dd5e8 >2013-12-09 15:59:21,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e15322a >2013-12-09 15:59:22,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e15322a >2013-12-09 15:59:22,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12985d9d >2013-12-09 15:59:22,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12985d9d >2013-12-09 15:59:27,281 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-65) No up server in cluster >2013-12-09 15:59:27,281 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-65) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 15:59:27,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4930d6ea >2013-12-09 15:59:27,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 221d84d >2013-12-09 15:59:27,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4930d6ea >2013-12-09 15:59:28,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 221d84d >2013-12-09 15:59:28,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3764822 >2013-12-09 15:59:28,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3764822 >2013-12-09 15:59:33,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4aaa3121 >2013-12-09 15:59:33,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4aaa3121 >2013-12-09 15:59:33,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33e3312b >2013-12-09 15:59:34,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33e3312b >2013-12-09 15:59:38,754 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) Attempting to update VMs/Templates Ovf. >2013-12-09 15:59:39,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 512ff79c >2013-12-09 15:59:39,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 512ff79c >2013-12-09 15:59:39,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 14c722fb >2013-12-09 15:59:39,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14c722fb >2013-12-09 15:59:44,711 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-20) Start refreshing all users data >2013-12-09 15:59:44,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66d57fa0 >2013-12-09 15:59:45,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 66d57fa0 >2013-12-09 15:59:45,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 324e9f36 >2013-12-09 15:59:45,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 324e9f36 >2013-12-09 15:59:50,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 414b9458 >2013-12-09 15:59:51,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 414b9458 >2013-12-09 15:59:51,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f74ed69 >2013-12-09 15:59:51,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f74ed69 >2013-12-09 15:59:56,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d5f00fa >2013-12-09 15:59:56,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2d5f00fa >2013-12-09 15:59:56,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2227a95a >2013-12-09 15:59:57,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2227a95a >2013-12-09 16:00:02,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24300af1 >2013-12-09 16:00:02,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 24300af1 >2013-12-09 16:00:02,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b25f5a8 >2013-12-09 16:00:02,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b25f5a8 >2013-12-09 16:00:07,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 553386b4 >2013-12-09 16:00:08,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 553386b4 >2013-12-09 16:00:08,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 358d6841 >2013-12-09 16:00:08,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 358d6841 >2013-12-09 16:00:13,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7706c7ff >2013-12-09 16:00:14,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7706c7ff >2013-12-09 16:00:14,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2aedf5db >2013-12-09 16:00:14,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2aedf5db >2013-12-09 16:00:19,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 481c4ff3 >2013-12-09 16:00:20,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 481c4ff3 >2013-12-09 16:00:20,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 11d6911e >2013-12-09 16:00:20,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11d6911e >2013-12-09 16:00:25,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2834971c >2013-12-09 16:00:25,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2834971c >2013-12-09 16:00:25,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6144691 >2013-12-09 16:00:26,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6144691 >2013-12-09 16:00:27,573 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-74) No up server in cluster >2013-12-09 16:00:27,573 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-74) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:00:27,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4aec03f1 >2013-12-09 16:00:27,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4aec03f1 >2013-12-09 16:00:31,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9851ef0 >2013-12-09 16:00:31,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 9851ef0 >2013-12-09 16:00:31,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21bc5ef0 >2013-12-09 16:00:31,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21bc5ef0 >2013-12-09 16:00:36,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2150e614 >2013-12-09 16:00:37,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2150e614 >2013-12-09 16:00:37,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 18e16ab0 >2013-12-09 16:00:37,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18e16ab0 >2013-12-09 16:00:42,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 497c747 >2013-12-09 16:00:43,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 497c747 >2013-12-09 16:00:43,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f8b0a3d >2013-12-09 16:00:43,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f8b0a3d >2013-12-09 16:00:48,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7544810 >2013-12-09 16:00:48,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7544810 >2013-12-09 16:00:48,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2693ac0a >2013-12-09 16:00:49,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2693ac0a >2013-12-09 16:00:54,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f9d2410 >2013-12-09 16:00:54,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3f9d2410 >2013-12-09 16:00:54,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c89b3d0 >2013-12-09 16:00:54,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c89b3d0 >2013-12-09 16:01:00,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32ba72bf >2013-12-09 16:01:00,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 32ba72bf >2013-12-09 16:01:00,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26a5d6b8 >2013-12-09 16:01:00,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26a5d6b8 >2013-12-09 16:01:05,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23124546 >2013-12-09 16:01:06,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 23124546 >2013-12-09 16:01:06,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 256c68e9 >2013-12-09 16:01:06,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 256c68e9 >2013-12-09 16:01:11,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e720501 >2013-12-09 16:01:12,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7e720501 >2013-12-09 16:01:12,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 524a0283 >2013-12-09 16:01:12,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 524a0283 >2013-12-09 16:01:17,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: cec63d3 >2013-12-09 16:01:17,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: cec63d3 >2013-12-09 16:01:17,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28e9a694 >2013-12-09 16:01:18,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28e9a694 >2013-12-09 16:01:23,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 718e145a >2013-12-09 16:01:23,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 718e145a >2013-12-09 16:01:23,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29d91fd9 >2013-12-09 16:01:23,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29d91fd9 >2013-12-09 16:01:27,842 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-35) No up server in cluster >2013-12-09 16:01:27,842 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-35) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:01:27,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: cf42d8 >2013-12-09 16:01:28,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterTasksListVDSCommand, return: [], log id: cf42d8 >2013-12-09 16:01:28,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5a4c0fb5 >2013-12-09 16:01:29,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5a4c0fb5 >2013-12-09 16:01:29,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a7ae70f >2013-12-09 16:01:29,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a7ae70f >2013-12-09 16:01:34,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1bce9f5d >2013-12-09 16:01:35,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1bce9f5d >2013-12-09 16:01:35,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4351ccd >2013-12-09 16:01:35,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4351ccd >2013-12-09 16:01:40,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3455bb19 >2013-12-09 16:01:40,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3455bb19 >2013-12-09 16:01:40,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40a46e10 >2013-12-09 16:01:41,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40a46e10 >2013-12-09 16:01:46,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 448f1285 >2013-12-09 16:01:46,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 448f1285 >2013-12-09 16:01:46,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f254413 >2013-12-09 16:01:46,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f254413 >2013-12-09 16:01:52,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60458754 >2013-12-09 16:01:52,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 60458754 >2013-12-09 16:01:52,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 22d30466 >2013-12-09 16:01:52,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22d30466 >2013-12-09 16:01:57,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f33bfbb >2013-12-09 16:01:58,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f33bfbb >2013-12-09 16:01:58,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4d6eafec >2013-12-09 16:01:58,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d6eafec >2013-12-09 16:02:03,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 776e6621 >2013-12-09 16:02:04,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 776e6621 >2013-12-09 16:02:04,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5992e856 >2013-12-09 16:02:04,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5992e856 >2013-12-09 16:02:09,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55a385d5 >2013-12-09 16:02:09,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 55a385d5 >2013-12-09 16:02:09,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4958db39 >2013-12-09 16:02:10,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4958db39 >2013-12-09 16:02:15,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 488e159c >2013-12-09 16:02:15,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 488e159c >2013-12-09 16:02:15,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a44cffc >2013-12-09 16:02:15,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a44cffc >2013-12-09 16:02:20,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5bec963e >2013-12-09 16:02:21,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5bec963e >2013-12-09 16:02:21,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38fd4342 >2013-12-09 16:02:21,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38fd4342 >2013-12-09 16:02:26,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ff0a557 >2013-12-09 16:02:27,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: ff0a557 >2013-12-09 16:02:27,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 471469a7 >2013-12-09 16:02:27,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 471469a7 >2013-12-09 16:02:28,129 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-83) No up server in cluster >2013-12-09 16:02:28,129 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-83) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:02:28,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65154e1d >2013-12-09 16:02:28,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterTasksListVDSCommand, return: [], log id: 65154e1d >2013-12-09 16:02:32,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64f517df >2013-12-09 16:02:32,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 64f517df >2013-12-09 16:02:32,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4761c030 >2013-12-09 16:02:33,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4761c030 >2013-12-09 16:02:38,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5c6c56e5 >2013-12-09 16:02:38,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5c6c56e5 >2013-12-09 16:02:38,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1cf3993 >2013-12-09 16:02:38,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1cf3993 >2013-12-09 16:02:44,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63a6ddba >2013-12-09 16:02:44,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 63a6ddba >2013-12-09 16:02:44,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 72f46c3a >2013-12-09 16:02:44,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72f46c3a >2013-12-09 16:02:49,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3cb23b52 >2013-12-09 16:02:50,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3cb23b52 >2013-12-09 16:02:50,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61cc9936 >2013-12-09 16:02:50,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61cc9936 >2013-12-09 16:02:55,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b3e35b6 >2013-12-09 16:02:56,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b3e35b6 >2013-12-09 16:02:56,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 216240fd >2013-12-09 16:02:56,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 216240fd >2013-12-09 16:03:01,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a1adec3 >2013-12-09 16:03:01,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: a1adec3 >2013-12-09 16:03:01,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d98221a >2013-12-09 16:03:02,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d98221a >2013-12-09 16:03:07,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c57be2b >2013-12-09 16:03:07,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2c57be2b >2013-12-09 16:03:07,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f5b43a4 >2013-12-09 16:03:07,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f5b43a4 >2013-12-09 16:03:12,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b72a1a1 >2013-12-09 16:03:13,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b72a1a1 >2013-12-09 16:03:13,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3108f4f7 >2013-12-09 16:03:13,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3108f4f7 >2013-12-09 16:03:18,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7998053a >2013-12-09 16:03:19,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7998053a >2013-12-09 16:03:19,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f6982b3 >2013-12-09 16:03:19,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f6982b3 >2013-12-09 16:03:24,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 589ac868 >2013-12-09 16:03:24,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 589ac868 >2013-12-09 16:03:24,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f2156e4 >2013-12-09 16:03:25,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f2156e4 >2013-12-09 16:03:28,397 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-89) No up server in cluster >2013-12-09 16:03:28,397 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-89) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:03:28,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7c5215c9 >2013-12-09 16:03:28,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7c5215c9 >2013-12-09 16:03:30,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 255ad132 >2013-12-09 16:03:30,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 255ad132 >2013-12-09 16:03:30,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c880024 >2013-12-09 16:03:31,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c880024 >2013-12-09 16:03:36,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3340d7d4 >2013-12-09 16:03:36,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3340d7d4 >2013-12-09 16:03:36,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69804261 >2013-12-09 16:03:36,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69804261 >2013-12-09 16:03:41,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7654ecbc >2013-12-09 16:03:42,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7654ecbc >2013-12-09 16:03:42,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6676e074 >2013-12-09 16:03:42,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6676e074 >2013-12-09 16:03:47,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e5cbf91 >2013-12-09 16:03:48,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e5cbf91 >2013-12-09 16:03:48,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bef8741 >2013-12-09 16:03:48,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bef8741 >2013-12-09 16:03:53,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69d2b547 >2013-12-09 16:03:53,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 69d2b547 >2013-12-09 16:03:53,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 249b206a >2013-12-09 16:03:54,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 249b206a >2013-12-09 16:03:59,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73ac60c3 >2013-12-09 16:03:59,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 73ac60c3 >2013-12-09 16:03:59,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a66a15c >2013-12-09 16:03:59,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a66a15c >2013-12-09 16:04:04,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7eb1592d >2013-12-09 16:04:05,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7eb1592d >2013-12-09 16:04:05,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62fbbeed >2013-12-09 16:04:05,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62fbbeed >2013-12-09 16:04:10,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 190dc99c >2013-12-09 16:04:11,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 190dc99c >2013-12-09 16:04:11,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a6ffdd >2013-12-09 16:04:11,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a6ffdd >2013-12-09 16:04:16,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58d558c9 >2013-12-09 16:04:16,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 58d558c9 >2013-12-09 16:04:16,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 33dd4860 >2013-12-09 16:04:17,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33dd4860 >2013-12-09 16:04:22,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2207c928 >2013-12-09 16:04:22,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2207c928 >2013-12-09 16:04:22,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1270a763 >2013-12-09 16:04:23,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1270a763 >2013-12-09 16:04:28,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45f0a23b >2013-12-09 16:04:28,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 45f0a23b >2013-12-09 16:04:28,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68150d3b >2013-12-09 16:04:28,689 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-77) No up server in cluster >2013-12-09 16:04:28,689 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-77) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:04:28,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 795d7f99 >2013-12-09 16:04:28,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68150d3b >2013-12-09 16:04:28,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterTasksListVDSCommand, return: [], log id: 795d7f99 >2013-12-09 16:04:33,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f330a2b >2013-12-09 16:04:34,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f330a2b >2013-12-09 16:04:34,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c3828d4 >2013-12-09 16:04:34,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c3828d4 >2013-12-09 16:04:39,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26d1ed71 >2013-12-09 16:04:40,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 26d1ed71 >2013-12-09 16:04:40,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47542cb3 >2013-12-09 16:04:40,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47542cb3 >2013-12-09 16:04:45,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28c3667 >2013-12-09 16:04:45,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 28c3667 >2013-12-09 16:04:45,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d3bfb16 >2013-12-09 16:04:46,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d3bfb16 >2013-12-09 16:04:51,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24f42713 >2013-12-09 16:04:51,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 24f42713 >2013-12-09 16:04:51,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58731a5f >2013-12-09 16:04:51,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58731a5f >2013-12-09 16:04:56,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3cc5c669 >2013-12-09 16:04:57,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3cc5c669 >2013-12-09 16:04:57,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a80f7c >2013-12-09 16:04:57,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a80f7c >2013-12-09 16:05:02,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 61d9db16 >2013-12-09 16:05:03,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 61d9db16 >2013-12-09 16:05:03,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 458129b7 >2013-12-09 16:05:03,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 458129b7 >2013-12-09 16:05:08,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 640aa95d >2013-12-09 16:05:09,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 640aa95d >2013-12-09 16:05:09,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51a7bb5b >2013-12-09 16:05:09,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51a7bb5b >2013-12-09 16:05:14,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39a20172 >2013-12-09 16:05:14,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 39a20172 >2013-12-09 16:05:14,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c228595 >2013-12-09 16:05:15,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c228595 >2013-12-09 16:05:20,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3525d8a5 >2013-12-09 16:05:20,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3525d8a5 >2013-12-09 16:05:20,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75d6c1fd >2013-12-09 16:05:20,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75d6c1fd >2013-12-09 16:05:25,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e7bb221 >2013-12-09 16:05:26,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3e7bb221 >2013-12-09 16:05:26,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6888281d >2013-12-09 16:05:26,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6888281d >2013-12-09 16:05:28,977 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-34) No up server in cluster >2013-12-09 16:05:28,977 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-34) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:05:28,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 21f5bc1 >2013-12-09 16:05:29,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterTasksListVDSCommand, return: [], log id: 21f5bc1 >2013-12-09 16:05:31,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 548aee30 >2013-12-09 16:05:32,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 548aee30 >2013-12-09 16:05:32,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f47e2b9 >2013-12-09 16:05:32,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f47e2b9 >2013-12-09 16:05:37,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b8b45ad >2013-12-09 16:05:37,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b8b45ad >2013-12-09 16:05:37,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57487268 >2013-12-09 16:05:38,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57487268 >2013-12-09 16:05:43,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 473a92b >2013-12-09 16:05:43,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 473a92b >2013-12-09 16:05:43,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f597e4f >2013-12-09 16:05:43,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f597e4f >2013-12-09 16:05:48,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f1484a1 >2013-12-09 16:05:49,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6f1484a1 >2013-12-09 16:05:49,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: f49fc1a >2013-12-09 16:05:49,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f49fc1a >2013-12-09 16:05:54,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52665a35 >2013-12-09 16:05:55,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 52665a35 >2013-12-09 16:05:55,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c2ab3b7 >2013-12-09 16:05:55,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c2ab3b7 >2013-12-09 16:06:00,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d88b333 >2013-12-09 16:06:01,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d88b333 >2013-12-09 16:06:01,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2231a114 >2013-12-09 16:06:01,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2231a114 >2013-12-09 16:06:06,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 681f690e >2013-12-09 16:06:06,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 681f690e >2013-12-09 16:06:06,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 165094a0 >2013-12-09 16:06:07,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 165094a0 >2013-12-09 16:06:12,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ab8227e >2013-12-09 16:06:12,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5ab8227e >2013-12-09 16:06:12,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 296fc6f0 >2013-12-09 16:06:12,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 296fc6f0 >2013-12-09 16:06:17,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a9f0722 >2013-12-09 16:06:18,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a9f0722 >2013-12-09 16:06:18,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6cc3fc9a >2013-12-09 16:06:18,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6cc3fc9a >2013-12-09 16:06:23,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5f764e49 >2013-12-09 16:06:24,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5f764e49 >2013-12-09 16:06:24,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4eed200 >2013-12-09 16:06:24,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4eed200 >2013-12-09 16:06:29,257 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-80) No up server in cluster >2013-12-09 16:06:29,258 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-80) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:06:29,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b62d73c >2013-12-09 16:06:29,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b42eac9 >2013-12-09 16:06:29,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6b62d73c >2013-12-09 16:06:29,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b42eac9 >2013-12-09 16:06:29,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 612673e >2013-12-09 16:06:30,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 612673e >2013-12-09 16:06:35,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19c437a6 >2013-12-09 16:06:35,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 19c437a6 >2013-12-09 16:06:35,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3950c4ef >2013-12-09 16:06:35,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3950c4ef >2013-12-09 16:06:40,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 710c4c3d >2013-12-09 16:06:41,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 710c4c3d >2013-12-09 16:06:41,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 22f5dd0 >2013-12-09 16:06:41,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22f5dd0 >2013-12-09 16:06:46,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66156f2 >2013-12-09 16:06:47,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 66156f2 >2013-12-09 16:06:47,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3af512e8 >2013-12-09 16:06:47,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3af512e8 >2013-12-09 16:06:52,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ea56c26 >2013-12-09 16:06:53,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2ea56c26 >2013-12-09 16:06:53,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d0e7998 >2013-12-09 16:06:53,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d0e7998 >2013-12-09 16:06:58,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a75e1f9 >2013-12-09 16:06:58,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4a75e1f9 >2013-12-09 16:06:58,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 519dd85 >2013-12-09 16:06:59,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 519dd85 >2013-12-09 16:07:04,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a1d3116 >2013-12-09 16:07:04,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7a1d3116 >2013-12-09 16:07:04,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4dc7b8c2 >2013-12-09 16:07:04,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4dc7b8c2 >2013-12-09 16:07:09,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f560724 >2013-12-09 16:07:10,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2f560724 >2013-12-09 16:07:10,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 104b5848 >2013-12-09 16:07:10,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 104b5848 >2013-12-09 16:07:15,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47af34a >2013-12-09 16:07:16,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 47af34a >2013-12-09 16:07:16,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a60611f >2013-12-09 16:07:16,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a60611f >2013-12-09 16:07:21,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4575ffe6 >2013-12-09 16:07:22,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4575ffe6 >2013-12-09 16:07:22,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29cdd229 >2013-12-09 16:07:22,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29cdd229 >2013-12-09 16:07:27,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 189c30d2 >2013-12-09 16:07:27,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 189c30d2 >2013-12-09 16:07:27,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26f7c22a >2013-12-09 16:07:28,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26f7c22a >2013-12-09 16:07:29,526 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-22) No up server in cluster >2013-12-09 16:07:29,526 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-22) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:07:29,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4cb591c >2013-12-09 16:07:29,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4cb591c >2013-12-09 16:07:33,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6424d77 >2013-12-09 16:07:33,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6424d77 >2013-12-09 16:07:33,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 623cd1f8 >2013-12-09 16:07:33,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 623cd1f8 >2013-12-09 16:07:38,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 14e6c38c >2013-12-09 16:07:39,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 14e6c38c >2013-12-09 16:07:39,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b2d1531 >2013-12-09 16:07:39,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b2d1531 >2013-12-09 16:07:44,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 519bda94 >2013-12-09 16:07:45,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 519bda94 >2013-12-09 16:07:45,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a628628 >2013-12-09 16:07:45,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a628628 >2013-12-09 16:07:50,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2647df41 >2013-12-09 16:07:50,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2647df41 >2013-12-09 16:07:50,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 44798bc7 >2013-12-09 16:07:51,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44798bc7 >2013-12-09 16:07:56,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7eb94e18 >2013-12-09 16:07:56,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7eb94e18 >2013-12-09 16:07:56,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 399701b5 >2013-12-09 16:07:56,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 399701b5 >2013-12-09 16:08:01,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10ef8a24 >2013-12-09 16:08:02,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 10ef8a24 >2013-12-09 16:08:02,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 211982bc >2013-12-09 16:08:02,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 211982bc >2013-12-09 16:08:07,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 392b3407 >2013-12-09 16:08:08,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 392b3407 >2013-12-09 16:08:08,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29ba2dc0 >2013-12-09 16:08:08,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29ba2dc0 >2013-12-09 16:08:13,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 471ae4f >2013-12-09 16:08:13,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 471ae4f >2013-12-09 16:08:13,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ae0b9e >2013-12-09 16:08:14,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ae0b9e >2013-12-09 16:08:19,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7484426d >2013-12-09 16:08:19,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7484426d >2013-12-09 16:08:19,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 428df1ea >2013-12-09 16:08:20,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 428df1ea >2013-12-09 16:08:25,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51617a45 >2013-12-09 16:08:25,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 51617a45 >2013-12-09 16:08:25,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b76e5f4 >2013-12-09 16:08:25,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b76e5f4 >2013-12-09 16:08:29,808 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-36) No up server in cluster >2013-12-09 16:08:29,808 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-36) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:08:29,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2539fa48 >2013-12-09 16:08:30,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2539fa48 >2013-12-09 16:08:30,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6afe3457 >2013-12-09 16:08:31,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6afe3457 >2013-12-09 16:08:31,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a42c7cd >2013-12-09 16:08:31,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a42c7cd >2013-12-09 16:08:36,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 789721eb >2013-12-09 16:08:37,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 789721eb >2013-12-09 16:08:37,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2275f8ef >2013-12-09 16:08:37,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2275f8ef >2013-12-09 16:08:42,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 574b4a27 >2013-12-09 16:08:42,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 574b4a27 >2013-12-09 16:08:42,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6261c411 >2013-12-09 16:08:43,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6261c411 >2013-12-09 16:08:48,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1391a49 >2013-12-09 16:08:48,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1391a49 >2013-12-09 16:08:48,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 97eb399 >2013-12-09 16:08:48,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 97eb399 >2013-12-09 16:08:53,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c2a0337 >2013-12-09 16:08:54,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3c2a0337 >2013-12-09 16:08:54,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b8e9091 >2013-12-09 16:08:54,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b8e9091 >2013-12-09 16:08:59,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d532288 >2013-12-09 16:09:00,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7d532288 >2013-12-09 16:09:00,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4acf63bd >2013-12-09 16:09:00,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4acf63bd >2013-12-09 16:09:05,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e4bb4d5 >2013-12-09 16:09:05,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3e4bb4d5 >2013-12-09 16:09:05,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 146ed47 >2013-12-09 16:09:06,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 146ed47 >2013-12-09 16:09:11,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 335c81e0 >2013-12-09 16:09:11,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 335c81e0 >2013-12-09 16:09:11,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 44730e2e >2013-12-09 16:09:12,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44730e2e >2013-12-09 16:09:17,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74eb48c7 >2013-12-09 16:09:17,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 74eb48c7 >2013-12-09 16:09:17,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 65ac8ee7 >2013-12-09 16:09:17,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65ac8ee7 >2013-12-09 16:09:22,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 49f9eff0 >2013-12-09 16:09:23,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 49f9eff0 >2013-12-09 16:09:23,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32d212f9 >2013-12-09 16:09:23,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32d212f9 >2013-12-09 16:09:28,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a3137b8 >2013-12-09 16:09:29,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a3137b8 >2013-12-09 16:09:29,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25074954 >2013-12-09 16:09:29,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25074954 >2013-12-09 16:09:30,083 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-70) No up server in cluster >2013-12-09 16:09:30,083 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-70) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:09:30,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1da79057 >2013-12-09 16:09:30,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1da79057 >2013-12-09 16:09:34,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f365cc7 >2013-12-09 16:09:34,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f365cc7 >2013-12-09 16:09:34,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d2d93ab >2013-12-09 16:09:35,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d2d93ab >2013-12-09 16:09:40,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3504255 >2013-12-09 16:09:40,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3504255 >2013-12-09 16:09:40,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 44ba242d >2013-12-09 16:09:40,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44ba242d >2013-12-09 16:09:46,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43d91b13 >2013-12-09 16:09:46,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 43d91b13 >2013-12-09 16:09:46,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25c79dff >2013-12-09 16:09:46,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25c79dff >2013-12-09 16:09:51,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a38d38 >2013-12-09 16:09:52,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: a38d38 >2013-12-09 16:09:52,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3fdf38b4 >2013-12-09 16:09:52,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3fdf38b4 >2013-12-09 16:09:57,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3501ea23 >2013-12-09 16:09:58,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3501ea23 >2013-12-09 16:09:58,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a0ff6a8 >2013-12-09 16:09:58,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a0ff6a8 >2013-12-09 16:10:03,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69fc6c22 >2013-12-09 16:10:03,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 69fc6c22 >2013-12-09 16:10:03,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a08cec5 >2013-12-09 16:10:04,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a08cec5 >2013-12-09 16:10:09,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62986c3 >2013-12-09 16:10:09,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 62986c3 >2013-12-09 16:10:09,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47155a >2013-12-09 16:10:09,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47155a >2013-12-09 16:10:14,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3cdf26f1 >2013-12-09 16:10:15,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3cdf26f1 >2013-12-09 16:10:15,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e03f0a6 >2013-12-09 16:10:15,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e03f0a6 >2013-12-09 16:10:20,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3454026e >2013-12-09 16:10:21,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3454026e >2013-12-09 16:10:21,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6eaf9abd >2013-12-09 16:10:21,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6eaf9abd >2013-12-09 16:10:26,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 120413f2 >2013-12-09 16:10:26,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 120413f2 >2013-12-09 16:10:26,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3675e668 >2013-12-09 16:10:27,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3675e668 >2013-12-09 16:10:30,359 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) No up server in cluster >2013-12-09 16:10:30,359 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:10:30,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7a2bc734 >2013-12-09 16:10:30,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7a2bc734 >2013-12-09 16:10:32,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61b5b726 >2013-12-09 16:10:32,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 61b5b726 >2013-12-09 16:10:32,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1403a82b >2013-12-09 16:10:33,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1403a82b >2013-12-09 16:10:38,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a9e4611 >2013-12-09 16:10:38,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3a9e4611 >2013-12-09 16:10:38,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a269981 >2013-12-09 16:10:38,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a269981 >2013-12-09 16:10:43,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d054087 >2013-12-09 16:10:44,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: d054087 >2013-12-09 16:10:44,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 233e15c3 >2013-12-09 16:10:44,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 233e15c3 >2013-12-09 16:10:49,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7f2f7c40 >2013-12-09 16:10:50,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7f2f7c40 >2013-12-09 16:10:50,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f1a7de1 >2013-12-09 16:10:50,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f1a7de1 >2013-12-09 16:10:55,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e64665c >2013-12-09 16:10:55,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: e64665c >2013-12-09 16:10:55,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4a3001f4 >2013-12-09 16:10:56,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a3001f4 >2013-12-09 16:11:01,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32848c17 >2013-12-09 16:11:01,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 32848c17 >2013-12-09 16:11:01,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e387601 >2013-12-09 16:11:01,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e387601 >2013-12-09 16:11:06,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 71f8bc8 >2013-12-09 16:11:07,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 71f8bc8 >2013-12-09 16:11:07,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d9521b7 >2013-12-09 16:11:07,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d9521b7 >2013-12-09 16:11:12,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 580dfb74 >2013-12-09 16:11:13,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 580dfb74 >2013-12-09 16:11:13,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8c0468a >2013-12-09 16:11:13,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8c0468a >2013-12-09 16:11:18,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 637d1eaf >2013-12-09 16:11:19,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 637d1eaf >2013-12-09 16:11:19,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f36c4d1 >2013-12-09 16:11:19,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f36c4d1 >2013-12-09 16:11:24,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e5099b2 >2013-12-09 16:11:24,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7e5099b2 >2013-12-09 16:11:24,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6abdccf1 >2013-12-09 16:11:25,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6abdccf1 >2013-12-09 16:11:30,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e3d8db1 >2013-12-09 16:11:30,636 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) No up server in cluster >2013-12-09 16:11:30,636 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:11:30,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: e3d8db1 >2013-12-09 16:11:30,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6cc242eb >2013-12-09 16:11:30,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40adc373 >2013-12-09 16:11:30,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6cc242eb >2013-12-09 16:11:30,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40adc373 >2013-12-09 16:11:35,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63a2fab0 >2013-12-09 16:11:36,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 63a2fab0 >2013-12-09 16:11:36,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27100bd2 >2013-12-09 16:11:36,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27100bd2 >2013-12-09 16:11:41,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: da76f33 >2013-12-09 16:11:42,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: da76f33 >2013-12-09 16:11:42,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 30db3af1 >2013-12-09 16:11:42,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30db3af1 >2013-12-09 16:11:47,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 51dba2a6 >2013-12-09 16:11:47,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 51dba2a6 >2013-12-09 16:11:47,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3675994d >2013-12-09 16:11:48,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3675994d >2013-12-09 16:11:53,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 474d71af >2013-12-09 16:11:53,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 474d71af >2013-12-09 16:11:53,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17d34af3 >2013-12-09 16:11:54,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17d34af3 >2013-12-09 16:11:59,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b008fb5 >2013-12-09 16:11:59,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4b008fb5 >2013-12-09 16:11:59,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 737d5144 >2013-12-09 16:11:59,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 737d5144 >2013-12-09 16:12:04,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5adb2a8 >2013-12-09 16:12:05,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5adb2a8 >2013-12-09 16:12:05,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 184c3c54 >2013-12-09 16:12:05,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 184c3c54 >2013-12-09 16:12:10,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 237c5072 >2013-12-09 16:12:11,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 237c5072 >2013-12-09 16:12:11,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 461df30e >2013-12-09 16:12:11,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 461df30e >2013-12-09 16:12:16,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78df070b >2013-12-09 16:12:16,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 78df070b >2013-12-09 16:12:16,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58efcac9 >2013-12-09 16:12:17,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58efcac9 >2013-12-09 16:12:22,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 62224de2 >2013-12-09 16:12:22,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 62224de2 >2013-12-09 16:12:22,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c0a98a2 >2013-12-09 16:12:22,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c0a98a2 >2013-12-09 16:12:27,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5618d237 >2013-12-09 16:12:28,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5618d237 >2013-12-09 16:12:28,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55757cac >2013-12-09 16:12:28,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55757cac >2013-12-09 16:12:30,909 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-100) No up server in cluster >2013-12-09 16:12:30,909 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-100) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:12:30,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4368ecb4 >2013-12-09 16:12:31,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4368ecb4 >2013-12-09 16:12:33,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 484f892a >2013-12-09 16:12:34,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 484f892a >2013-12-09 16:12:34,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 268f837d >2013-12-09 16:12:34,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 268f837d >2013-12-09 16:12:39,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 76d26df1 >2013-12-09 16:12:40,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 76d26df1 >2013-12-09 16:12:40,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b76b94e >2013-12-09 16:12:40,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b76b94e >2013-12-09 16:12:45,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7cef81dd >2013-12-09 16:12:45,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7cef81dd >2013-12-09 16:12:45,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f8b9ede >2013-12-09 16:12:46,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f8b9ede >2013-12-09 16:12:51,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 497b5891 >2013-12-09 16:12:51,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 497b5891 >2013-12-09 16:12:51,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a86772e >2013-12-09 16:12:51,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a86772e >2013-12-09 16:12:56,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 163349a8 >2013-12-09 16:12:57,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 163349a8 >2013-12-09 16:12:57,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56f3e877 >2013-12-09 16:12:57,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56f3e877 >2013-12-09 16:13:02,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35cfcdc1 >2013-12-09 16:13:03,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 35cfcdc1 >2013-12-09 16:13:03,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27a80c65 >2013-12-09 16:13:03,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27a80c65 >2013-12-09 16:13:08,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6778ace7 >2013-12-09 16:13:08,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6778ace7 >2013-12-09 16:13:08,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b26452 >2013-12-09 16:13:09,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b26452 >2013-12-09 16:13:14,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7451c421 >2013-12-09 16:13:14,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7451c421 >2013-12-09 16:13:14,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36d47d9f >2013-12-09 16:13:14,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36d47d9f >2013-12-09 16:13:19,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78d92c9f >2013-12-09 16:13:20,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 78d92c9f >2013-12-09 16:13:20,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2dd5a9a0 >2013-12-09 16:13:20,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2dd5a9a0 >2013-12-09 16:13:25,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 20fd7324 >2013-12-09 16:13:26,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 20fd7324 >2013-12-09 16:13:26,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fee18b6 >2013-12-09 16:13:26,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fee18b6 >2013-12-09 16:13:31,187 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-32) No up server in cluster >2013-12-09 16:13:31,187 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-32) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:13:31,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ad5317f >2013-12-09 16:13:31,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4ad5317f >2013-12-09 16:13:31,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ef541aa >2013-12-09 16:13:32,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7ef541aa >2013-12-09 16:13:32,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4fbfb0b3 >2013-12-09 16:13:32,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fbfb0b3 >2013-12-09 16:13:37,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 745d7988 >2013-12-09 16:13:37,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 745d7988 >2013-12-09 16:13:37,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75e7b091 >2013-12-09 16:13:38,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75e7b091 >2013-12-09 16:13:43,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3bd87356 >2013-12-09 16:13:43,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3bd87356 >2013-12-09 16:13:43,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76eff36e >2013-12-09 16:13:43,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76eff36e >2013-12-09 16:13:48,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 333636ca >2013-12-09 16:13:49,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 333636ca >2013-12-09 16:13:49,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f1e6e3a >2013-12-09 16:13:49,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f1e6e3a >2013-12-09 16:13:54,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 152e7847 >2013-12-09 16:13:55,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 152e7847 >2013-12-09 16:13:55,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7230443 >2013-12-09 16:13:55,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7230443 >2013-12-09 16:14:00,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 738d2e26 >2013-12-09 16:14:00,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 738d2e26 >2013-12-09 16:14:00,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c88cb1b >2013-12-09 16:14:01,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c88cb1b >2013-12-09 16:14:06,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6aa148ec >2013-12-09 16:14:06,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6aa148ec >2013-12-09 16:14:06,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66813302 >2013-12-09 16:14:06,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66813302 >2013-12-09 16:14:12,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2287b237 >2013-12-09 16:14:12,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2287b237 >2013-12-09 16:14:12,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e1bdd3f >2013-12-09 16:14:12,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e1bdd3f >2013-12-09 16:14:17,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d9c9f9f >2013-12-09 16:14:18,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: d9c9f9f >2013-12-09 16:14:18,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1161f2a8 >2013-12-09 16:14:18,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1161f2a8 >2013-12-09 16:14:23,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6362b157 >2013-12-09 16:14:24,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6362b157 >2013-12-09 16:14:24,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5915cdd4 >2013-12-09 16:14:24,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5915cdd4 >2013-12-09 16:14:29,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 148cd301 >2013-12-09 16:14:29,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 148cd301 >2013-12-09 16:14:29,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1880bc97 >2013-12-09 16:14:30,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1880bc97 >2013-12-09 16:14:31,465 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-58) No up server in cluster >2013-12-09 16:14:31,465 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-58) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:14:31,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b9fb93e >2013-12-09 16:14:31,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterTasksListVDSCommand, return: [], log id: 6b9fb93e >2013-12-09 16:14:35,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5ad79732 >2013-12-09 16:14:35,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5ad79732 >2013-12-09 16:14:35,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 202617e2 >2013-12-09 16:14:35,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 202617e2 >2013-12-09 16:14:40,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39b174c4 >2013-12-09 16:14:41,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 39b174c4 >2013-12-09 16:14:41,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4a668b2d >2013-12-09 16:14:41,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a668b2d >2013-12-09 16:14:46,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 524042af >2013-12-09 16:14:47,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 524042af >2013-12-09 16:14:47,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 110b796f >2013-12-09 16:14:47,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 110b796f >2013-12-09 16:14:52,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 767b92c6 >2013-12-09 16:14:52,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 767b92c6 >2013-12-09 16:14:52,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39bd4a14 >2013-12-09 16:14:53,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39bd4a14 >2013-12-09 16:14:58,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a2eba6a >2013-12-09 16:14:58,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: a2eba6a >2013-12-09 16:14:58,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6643767 >2013-12-09 16:14:58,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6643767 >2013-12-09 16:15:04,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 27d43aa4 >2013-12-09 16:15:04,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 27d43aa4 >2013-12-09 16:15:04,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e0a8b1a >2013-12-09 16:15:04,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e0a8b1a >2013-12-09 16:15:09,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d89dc66 >2013-12-09 16:15:10,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d89dc66 >2013-12-09 16:15:10,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ec5e848 >2013-12-09 16:15:10,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ec5e848 >2013-12-09 16:15:15,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: fee49e4 >2013-12-09 16:15:16,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: fee49e4 >2013-12-09 16:15:16,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e264d27 >2013-12-09 16:15:16,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e264d27 >2013-12-09 16:15:21,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 421cc619 >2013-12-09 16:15:21,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 421cc619 >2013-12-09 16:15:21,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66623db0 >2013-12-09 16:15:22,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66623db0 >2013-12-09 16:15:27,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 389b04d4 >2013-12-09 16:15:27,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 389b04d4 >2013-12-09 16:15:27,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b6c6ac6 >2013-12-09 16:15:27,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b6c6ac6 >2013-12-09 16:15:31,750 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-5) No up server in cluster >2013-12-09 16:15:31,750 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-5) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:15:31,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55e79114 >2013-12-09 16:15:32,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterTasksListVDSCommand, return: [], log id: 55e79114 >2013-12-09 16:15:32,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 489d3335 >2013-12-09 16:15:33,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 489d3335 >2013-12-09 16:15:33,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e86c67 >2013-12-09 16:15:33,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e86c67 >2013-12-09 16:15:38,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1296bf0 >2013-12-09 16:15:39,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1296bf0 >2013-12-09 16:15:39,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35fb36a5 >2013-12-09 16:15:39,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35fb36a5 >2013-12-09 16:15:44,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5506de50 >2013-12-09 16:15:44,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5506de50 >2013-12-09 16:15:44,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5125dd60 >2013-12-09 16:15:45,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5125dd60 >2013-12-09 16:15:50,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b08aea9 >2013-12-09 16:15:50,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2b08aea9 >2013-12-09 16:15:50,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d1f6b45 >2013-12-09 16:15:50,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d1f6b45 >2013-12-09 16:15:55,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 485bc58b >2013-12-09 16:15:56,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 485bc58b >2013-12-09 16:15:56,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 205ea07a >2013-12-09 16:15:56,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 205ea07a >2013-12-09 16:16:01,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40d97851 >2013-12-09 16:16:02,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 40d97851 >2013-12-09 16:16:02,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ca4905f >2013-12-09 16:16:02,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ca4905f >2013-12-09 16:16:07,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2e505b86 >2013-12-09 16:16:08,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2e505b86 >2013-12-09 16:16:08,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46bbace8 >2013-12-09 16:16:08,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46bbace8 >2013-12-09 16:16:13,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: df240c3 >2013-12-09 16:16:13,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: df240c3 >2013-12-09 16:16:13,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 29d59db7 >2013-12-09 16:16:14,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29d59db7 >2013-12-09 16:16:19,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f90b31 >2013-12-09 16:16:19,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f90b31 >2013-12-09 16:16:19,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40689a2a >2013-12-09 16:16:19,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40689a2a >2013-12-09 16:16:24,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4dae872a >2013-12-09 16:16:25,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4dae872a >2013-12-09 16:16:25,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58a2b338 >2013-12-09 16:16:25,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58a2b338 >2013-12-09 16:16:30,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4083b20a >2013-12-09 16:16:31,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4083b20a >2013-12-09 16:16:31,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3686a6c1 >2013-12-09 16:16:31,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3686a6c1 >2013-12-09 16:16:32,033 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-53) No up server in cluster >2013-12-09 16:16:32,034 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-53) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:16:32,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 486bf6bd >2013-12-09 16:16:32,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterTasksListVDSCommand, return: [], log id: 486bf6bd >2013-12-09 16:16:36,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 989ab76 >2013-12-09 16:16:36,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 989ab76 >2013-12-09 16:16:36,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f98a09b >2013-12-09 16:16:37,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f98a09b >2013-12-09 16:16:42,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26cc5431 >2013-12-09 16:16:42,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 26cc5431 >2013-12-09 16:16:42,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 376dc41c >2013-12-09 16:16:42,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 376dc41c >2013-12-09 16:16:48,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 783d49d4 >2013-12-09 16:16:48,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 783d49d4 >2013-12-09 16:16:48,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67c991f8 >2013-12-09 16:16:48,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67c991f8 >2013-12-09 16:16:53,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5502b923 >2013-12-09 16:16:54,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5502b923 >2013-12-09 16:16:54,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f79580f >2013-12-09 16:16:54,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f79580f >2013-12-09 16:16:59,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45146190 >2013-12-09 16:17:00,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 45146190 >2013-12-09 16:17:00,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 49790f73 >2013-12-09 16:17:00,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49790f73 >2013-12-09 16:17:05,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c815a49 >2013-12-09 16:17:05,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3c815a49 >2013-12-09 16:17:05,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36a315a9 >2013-12-09 16:17:06,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36a315a9 >2013-12-09 16:17:11,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 354cba8a >2013-12-09 16:17:11,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 354cba8a >2013-12-09 16:17:11,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f80036b >2013-12-09 16:17:11,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f80036b >2013-12-09 16:17:16,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c93c1d >2013-12-09 16:17:17,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1c93c1d >2013-12-09 16:17:17,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4544e6f0 >2013-12-09 16:17:17,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4544e6f0 >2013-12-09 16:17:22,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34ac9174 >2013-12-09 16:17:23,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 34ac9174 >2013-12-09 16:17:23,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55b97dfd >2013-12-09 16:17:23,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55b97dfd >2013-12-09 16:17:28,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 731050ce >2013-12-09 16:17:28,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 731050ce >2013-12-09 16:17:28,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 302f0973 >2013-12-09 16:17:29,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 302f0973 >2013-12-09 16:17:32,299 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-64) No up server in cluster >2013-12-09 16:17:32,299 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-64) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:17:32,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 39dc12dd >2013-12-09 16:17:32,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterTasksListVDSCommand, return: [], log id: 39dc12dd >2013-12-09 16:17:34,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c38e5e3 >2013-12-09 16:17:34,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7c38e5e3 >2013-12-09 16:17:34,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d805a4a >2013-12-09 16:17:35,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d805a4a >2013-12-09 16:17:40,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 79359036 >2013-12-09 16:17:40,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 79359036 >2013-12-09 16:17:40,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39405504 >2013-12-09 16:17:40,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39405504 >2013-12-09 16:17:45,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68e9fbdd >2013-12-09 16:17:46,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 68e9fbdd >2013-12-09 16:17:46,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2cf42cf2 >2013-12-09 16:17:46,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2cf42cf2 >2013-12-09 16:17:51,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b6fcbd2 >2013-12-09 16:17:52,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5b6fcbd2 >2013-12-09 16:17:52,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b41b35a >2013-12-09 16:17:52,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b41b35a >2013-12-09 16:17:57,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c269485 >2013-12-09 16:17:57,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c269485 >2013-12-09 16:17:57,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ab93274 >2013-12-09 16:17:58,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ab93274 >2013-12-09 16:18:03,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6497e3c7 >2013-12-09 16:18:03,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6497e3c7 >2013-12-09 16:18:03,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31a1410f >2013-12-09 16:18:03,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31a1410f >2013-12-09 16:18:08,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d9bfd01 >2013-12-09 16:18:09,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3d9bfd01 >2013-12-09 16:18:09,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fa76854 >2013-12-09 16:18:09,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2fa76854 >2013-12-09 16:18:14,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e97046a >2013-12-09 16:18:15,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1e97046a >2013-12-09 16:18:15,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45fd9481 >2013-12-09 16:18:15,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45fd9481 >2013-12-09 16:18:20,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59688442 >2013-12-09 16:18:20,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59688442 >2013-12-09 16:18:20,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 425a8bba >2013-12-09 16:18:21,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 425a8bba >2013-12-09 16:18:26,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5fc1a401 >2013-12-09 16:18:26,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5fc1a401 >2013-12-09 16:18:26,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34f31218 >2013-12-09 16:18:26,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34f31218 >2013-12-09 16:18:32,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ed51f1b >2013-12-09 16:18:32,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ed51f1b >2013-12-09 16:18:32,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4647a9fc >2013-12-09 16:18:32,574 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-49) No up server in cluster >2013-12-09 16:18:32,574 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-49) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:18:32,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c1720d5 >2013-12-09 16:18:32,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4647a9fc >2013-12-09 16:18:32,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4c1720d5 >2013-12-09 16:18:37,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42ed49be >2013-12-09 16:18:38,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 42ed49be >2013-12-09 16:18:38,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 24cc82fb >2013-12-09 16:18:38,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24cc82fb >2013-12-09 16:18:43,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ffa0047 >2013-12-09 16:18:44,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4ffa0047 >2013-12-09 16:18:44,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f70189d >2013-12-09 16:18:44,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f70189d >2013-12-09 16:18:49,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47fc90de >2013-12-09 16:18:49,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 47fc90de >2013-12-09 16:18:49,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5cbc1779 >2013-12-09 16:18:50,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cbc1779 >2013-12-09 16:18:55,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 469151bf >2013-12-09 16:18:55,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 469151bf >2013-12-09 16:18:55,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 684e1902 >2013-12-09 16:18:55,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 684e1902 >2013-12-09 16:19:00,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 614e5508 >2013-12-09 16:19:01,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 614e5508 >2013-12-09 16:19:01,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5851f37 >2013-12-09 16:19:01,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5851f37 >2013-12-09 16:19:06,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1eb07fa7 >2013-12-09 16:19:07,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1eb07fa7 >2013-12-09 16:19:07,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4dd8ccd >2013-12-09 16:19:07,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4dd8ccd >2013-12-09 16:19:12,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d4759ad >2013-12-09 16:19:12,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d4759ad >2013-12-09 16:19:12,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 650e86ce >2013-12-09 16:19:13,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 650e86ce >2013-12-09 16:19:18,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6c79c47b >2013-12-09 16:19:18,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6c79c47b >2013-12-09 16:19:18,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78e23952 >2013-12-09 16:19:18,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78e23952 >2013-12-09 16:19:24,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78176e5d >2013-12-09 16:19:24,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 78176e5d >2013-12-09 16:19:24,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b9950a2 >2013-12-09 16:19:24,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b9950a2 >2013-12-09 16:19:29,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 668b38e8 >2013-12-09 16:19:30,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 668b38e8 >2013-12-09 16:19:30,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 313c9283 >2013-12-09 16:19:30,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 313c9283 >2013-12-09 16:19:32,845 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-56) No up server in cluster >2013-12-09 16:19:32,845 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-56) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:19:32,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48e16032 >2013-12-09 16:19:33,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterTasksListVDSCommand, return: [], log id: 48e16032 >2013-12-09 16:19:35,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b1032b5 >2013-12-09 16:19:36,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b1032b5 >2013-12-09 16:19:36,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4454f96e >2013-12-09 16:19:36,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4454f96e >2013-12-09 16:19:41,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 759c98df >2013-12-09 16:19:41,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 759c98df >2013-12-09 16:19:41,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 63462721 >2013-12-09 16:19:42,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63462721 >2013-12-09 16:19:47,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2fd21ded >2013-12-09 16:19:47,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2fd21ded >2013-12-09 16:19:47,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35a7f7b1 >2013-12-09 16:19:47,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35a7f7b1 >2013-12-09 16:19:52,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1f2a13ab >2013-12-09 16:19:53,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1f2a13ab >2013-12-09 16:19:53,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3ba3a3ad >2013-12-09 16:19:53,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ba3a3ad >2013-12-09 16:19:58,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3bde7584 >2013-12-09 16:19:59,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3bde7584 >2013-12-09 16:19:59,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5844f0fe >2013-12-09 16:19:59,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5844f0fe >2013-12-09 16:20:04,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 22e0ccb4 >2013-12-09 16:20:04,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 22e0ccb4 >2013-12-09 16:20:04,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 524c73e >2013-12-09 16:20:05,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 524c73e >2013-12-09 16:20:10,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b5d55ad >2013-12-09 16:20:10,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b5d55ad >2013-12-09 16:20:10,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55ba5044 >2013-12-09 16:20:11,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55ba5044 >2013-12-09 16:20:16,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9174cb0 >2013-12-09 16:20:16,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 9174cb0 >2013-12-09 16:20:16,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12742064 >2013-12-09 16:20:16,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12742064 >2013-12-09 16:20:21,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4883c3ac >2013-12-09 16:20:22,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4883c3ac >2013-12-09 16:20:22,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7652c416 >2013-12-09 16:20:22,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7652c416 >2013-12-09 16:20:27,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e0f2e89 >2013-12-09 16:20:28,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e0f2e89 >2013-12-09 16:20:28,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6227c4ee >2013-12-09 16:20:28,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6227c4ee >2013-12-09 16:20:33,117 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-20) No up server in cluster >2013-12-09 16:20:33,117 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-20) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:20:33,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d67de57 >2013-12-09 16:20:33,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3d67de57 >2013-12-09 16:20:33,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76734301 >2013-12-09 16:20:33,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 76734301 >2013-12-09 16:20:33,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40121b41 >2013-12-09 16:20:34,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40121b41 >2013-12-09 16:20:39,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 143dc442 >2013-12-09 16:20:39,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 143dc442 >2013-12-09 16:20:39,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e5f08ec >2013-12-09 16:20:39,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e5f08ec >2013-12-09 16:20:44,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31301435 >2013-12-09 16:20:45,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 31301435 >2013-12-09 16:20:45,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: bf280f6 >2013-12-09 16:20:45,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: bf280f6 >2013-12-09 16:20:50,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 471362ff >2013-12-09 16:20:51,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 471362ff >2013-12-09 16:20:51,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 652bdbf6 >2013-12-09 16:20:51,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 652bdbf6 >2013-12-09 16:20:56,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72d06c86 >2013-12-09 16:20:57,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 72d06c86 >2013-12-09 16:20:57,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58ba01a >2013-12-09 16:20:57,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58ba01a >2013-12-09 16:21:02,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d0936f4 >2013-12-09 16:21:02,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4d0936f4 >2013-12-09 16:21:02,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38f29ee0 >2013-12-09 16:21:03,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38f29ee0 >2013-12-09 16:21:08,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 77e68fd3 >2013-12-09 16:21:08,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 77e68fd3 >2013-12-09 16:21:08,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c9477a4 >2013-12-09 16:21:08,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c9477a4 >2013-12-09 16:21:13,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29a261c6 >2013-12-09 16:21:14,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 29a261c6 >2013-12-09 16:21:14,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e5fe156 >2013-12-09 16:21:14,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e5fe156 >2013-12-09 16:21:19,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 408a8c61 >2013-12-09 16:21:20,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 408a8c61 >2013-12-09 16:21:20,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55553f5e >2013-12-09 16:21:20,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55553f5e >2013-12-09 16:21:25,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78a1decf >2013-12-09 16:21:25,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 78a1decf >2013-12-09 16:21:25,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 368850db >2013-12-09 16:21:26,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 368850db >2013-12-09 16:21:31,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5eb33aa >2013-12-09 16:21:31,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5eb33aa >2013-12-09 16:21:31,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18fd71b7 >2013-12-09 16:21:31,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18fd71b7 >2013-12-09 16:21:33,396 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-48) No up server in cluster >2013-12-09 16:21:33,396 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-48) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:21:33,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 458a9c7a >2013-12-09 16:21:33,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterTasksListVDSCommand, return: [], log id: 458a9c7a >2013-12-09 16:21:36,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: a92a6e2 >2013-12-09 16:21:37,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: a92a6e2 >2013-12-09 16:21:37,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5db838ef >2013-12-09 16:21:37,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5db838ef >2013-12-09 16:21:42,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64a39d19 >2013-12-09 16:21:43,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 64a39d19 >2013-12-09 16:21:43,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6222d4cc >2013-12-09 16:21:43,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6222d4cc >2013-12-09 16:21:48,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53a3dbd4 >2013-12-09 16:21:48,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 53a3dbd4 >2013-12-09 16:21:48,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 14f1d20b >2013-12-09 16:21:49,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14f1d20b >2013-12-09 16:21:54,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f33f71f >2013-12-09 16:21:54,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5f33f71f >2013-12-09 16:21:54,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4561dda >2013-12-09 16:21:54,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4561dda >2013-12-09 16:22:00,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57b8da38 >2013-12-09 16:22:00,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 57b8da38 >2013-12-09 16:22:00,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6be0c582 >2013-12-09 16:22:00,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6be0c582 >2013-12-09 16:22:05,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e91d947 >2013-12-09 16:22:06,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1e91d947 >2013-12-09 16:22:06,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 48523a40 >2013-12-09 16:22:06,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48523a40 >2013-12-09 16:22:11,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 610cdfc0 >2013-12-09 16:22:12,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 610cdfc0 >2013-12-09 16:22:12,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 609fdc32 >2013-12-09 16:22:12,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 609fdc32 >2013-12-09 16:22:17,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1158753a >2013-12-09 16:22:17,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1158753a >2013-12-09 16:22:17,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5af9620f >2013-12-09 16:22:18,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5af9620f >2013-12-09 16:22:23,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1243c68a >2013-12-09 16:22:23,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1243c68a >2013-12-09 16:22:23,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74f74989 >2013-12-09 16:22:23,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74f74989 >2013-12-09 16:22:28,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3bc3109a >2013-12-09 16:22:29,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3bc3109a >2013-12-09 16:22:29,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6372e65a >2013-12-09 16:22:29,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6372e65a >2013-12-09 16:22:33,667 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-88) No up server in cluster >2013-12-09 16:22:33,668 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-88) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:22:33,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8e4ebb1 >2013-12-09 16:22:33,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterTasksListVDSCommand, return: [], log id: 8e4ebb1 >2013-12-09 16:22:34,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 78f90695 >2013-12-09 16:22:35,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 78f90695 >2013-12-09 16:22:35,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3287d611 >2013-12-09 16:22:35,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3287d611 >2013-12-09 16:22:40,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 796fa11a >2013-12-09 16:22:41,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 796fa11a >2013-12-09 16:22:41,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1413fb4 >2013-12-09 16:22:41,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1413fb4 >2013-12-09 16:22:46,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29e8459b >2013-12-09 16:22:46,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 29e8459b >2013-12-09 16:22:46,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4cac8674 >2013-12-09 16:22:47,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4cac8674 >2013-12-09 16:22:52,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 40ef4fab >2013-12-09 16:22:52,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 40ef4fab >2013-12-09 16:22:52,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a317aa7 >2013-12-09 16:22:52,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a317aa7 >2013-12-09 16:22:57,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 67a31c82 >2013-12-09 16:22:58,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 67a31c82 >2013-12-09 16:22:58,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4aa80c13 >2013-12-09 16:22:58,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4aa80c13 >2013-12-09 16:23:03,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62905a84 >2013-12-09 16:23:04,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 62905a84 >2013-12-09 16:23:04,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b85ca1f >2013-12-09 16:23:04,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b85ca1f >2013-12-09 16:23:09,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c7e0f32 >2013-12-09 16:23:09,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: c7e0f32 >2013-12-09 16:23:09,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1cc18cd9 >2013-12-09 16:23:10,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1cc18cd9 >2013-12-09 16:23:15,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d82c0ef >2013-12-09 16:23:15,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6d82c0ef >2013-12-09 16:23:15,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45ef8e29 >2013-12-09 16:23:15,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45ef8e29 >2013-12-09 16:23:20,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47cd6ac1 >2013-12-09 16:23:21,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 47cd6ac1 >2013-12-09 16:23:21,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c351ae7 >2013-12-09 16:23:21,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c351ae7 >2013-12-09 16:23:26,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 60402c2c >2013-12-09 16:23:27,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 60402c2c >2013-12-09 16:23:27,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e24f7c2 >2013-12-09 16:23:27,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e24f7c2 >2013-12-09 16:23:32,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 647731c2 >2013-12-09 16:23:32,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 647731c2 >2013-12-09 16:23:32,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d08bb5 >2013-12-09 16:23:33,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d08bb5 >2013-12-09 16:23:33,945 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-39) [63f3d095] No up server in cluster >2013-12-09 16:23:33,945 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-39) [63f3d095] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:23:33,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1b1b90a1 >2013-12-09 16:23:34,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterTasksListVDSCommand, return: [], log id: 1b1b90a1 >2013-12-09 16:23:38,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b58016b >2013-12-09 16:23:38,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4b58016b >2013-12-09 16:23:38,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 757675ca >2013-12-09 16:23:39,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 757675ca >2013-12-09 16:23:44,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 42a9707f >2013-12-09 16:23:44,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 42a9707f >2013-12-09 16:23:44,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 719e16a1 >2013-12-09 16:23:44,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 719e16a1 >2013-12-09 16:23:49,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61815617 >2013-12-09 16:23:50,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 61815617 >2013-12-09 16:23:50,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c1e6ff2 >2013-12-09 16:23:50,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c1e6ff2 >2013-12-09 16:23:55,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c93eda0 >2013-12-09 16:23:56,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: c93eda0 >2013-12-09 16:23:56,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e769dff >2013-12-09 16:23:56,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e769dff >2013-12-09 16:24:01,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 51691a7b >2013-12-09 16:24:01,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 51691a7b >2013-12-09 16:24:01,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10eaeb04 >2013-12-09 16:24:02,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10eaeb04 >2013-12-09 16:24:07,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3fed2dc7 >2013-12-09 16:24:07,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3fed2dc7 >2013-12-09 16:24:07,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 8f84db8 >2013-12-09 16:24:07,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8f84db8 >2013-12-09 16:24:12,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 175f720b >2013-12-09 16:24:13,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 175f720b >2013-12-09 16:24:13,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47622868 >2013-12-09 16:24:13,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47622868 >2013-12-09 16:24:18,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ce891db >2013-12-09 16:24:19,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ce891db >2013-12-09 16:24:19,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7dc4a8fa >2013-12-09 16:24:19,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7dc4a8fa >2013-12-09 16:24:24,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4602bf25 >2013-12-09 16:24:25,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4602bf25 >2013-12-09 16:24:25,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bc70b0a >2013-12-09 16:24:25,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bc70b0a >2013-12-09 16:24:30,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 41775284 >2013-12-09 16:24:30,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 41775284 >2013-12-09 16:24:30,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3eeb380 >2013-12-09 16:24:31,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3eeb380 >2013-12-09 16:24:34,218 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-62) No up server in cluster >2013-12-09 16:24:34,218 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-62) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:24:34,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 19cca051 >2013-12-09 16:24:34,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterTasksListVDSCommand, return: [], log id: 19cca051 >2013-12-09 16:24:36,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17ec34cd >2013-12-09 16:24:36,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 17ec34cd >2013-12-09 16:24:36,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 178f5631 >2013-12-09 16:24:36,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 178f5631 >2013-12-09 16:24:41,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2a84bcfc >2013-12-09 16:24:42,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2a84bcfc >2013-12-09 16:24:42,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7930a64c >2013-12-09 16:24:42,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7930a64c >2013-12-09 16:24:47,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21e2f343 >2013-12-09 16:24:48,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 21e2f343 >2013-12-09 16:24:48,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 716788f8 >2013-12-09 16:24:48,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 716788f8 >2013-12-09 16:24:53,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 329b5506 >2013-12-09 16:24:53,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 329b5506 >2013-12-09 16:24:53,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1731ec92 >2013-12-09 16:24:54,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1731ec92 >2013-12-09 16:24:59,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f7d9f94 >2013-12-09 16:24:59,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5f7d9f94 >2013-12-09 16:24:59,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e092433 >2013-12-09 16:24:59,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e092433 >2013-12-09 16:25:04,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 155c3a45 >2013-12-09 16:25:05,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 155c3a45 >2013-12-09 16:25:05,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64fc2df2 >2013-12-09 16:25:05,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64fc2df2 >2013-12-09 16:25:10,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d8c5166 >2013-12-09 16:25:11,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: d8c5166 >2013-12-09 16:25:11,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c53ef2d >2013-12-09 16:25:11,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c53ef2d >2013-12-09 16:25:16,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 743e0fab >2013-12-09 16:25:16,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 743e0fab >2013-12-09 16:25:16,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 621c086c >2013-12-09 16:25:17,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 621c086c >2013-12-09 16:25:22,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 276998ee >2013-12-09 16:25:22,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 276998ee >2013-12-09 16:25:22,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3241350c >2013-12-09 16:25:23,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3241350c >2013-12-09 16:25:28,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4f21544e >2013-12-09 16:25:28,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4f21544e >2013-12-09 16:25:28,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6045f533 >2013-12-09 16:25:28,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6045f533 >2013-12-09 16:25:33,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 542bd5fb >2013-12-09 16:25:34,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 542bd5fb >2013-12-09 16:25:34,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10ffe46d >2013-12-09 16:25:34,496 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-36) No up server in cluster >2013-12-09 16:25:34,497 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-36) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:25:34,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75b9db28 >2013-12-09 16:25:34,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10ffe46d >2013-12-09 16:25:34,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterTasksListVDSCommand, return: [], log id: 75b9db28 >2013-12-09 16:25:39,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 69672473 >2013-12-09 16:25:40,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 69672473 >2013-12-09 16:25:40,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1c8b62c >2013-12-09 16:25:40,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c8b62c >2013-12-09 16:25:45,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e7b4676 >2013-12-09 16:25:45,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7e7b4676 >2013-12-09 16:25:45,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46c5564c >2013-12-09 16:25:46,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46c5564c >2013-12-09 16:25:51,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a9979d8 >2013-12-09 16:25:51,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6a9979d8 >2013-12-09 16:25:51,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4eaaec9d >2013-12-09 16:25:51,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4eaaec9d >2013-12-09 16:25:56,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ddda943 >2013-12-09 16:25:57,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6ddda943 >2013-12-09 16:25:57,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 44f42e22 >2013-12-09 16:25:57,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44f42e22 >2013-12-09 16:26:02,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5399718c >2013-12-09 16:26:03,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5399718c >2013-12-09 16:26:03,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ac11e15 >2013-12-09 16:26:03,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ac11e15 >2013-12-09 16:26:08,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 639e2e12 >2013-12-09 16:26:09,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 639e2e12 >2013-12-09 16:26:09,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50ee3001 >2013-12-09 16:26:09,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50ee3001 >2013-12-09 16:26:14,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 510282a5 >2013-12-09 16:26:14,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 510282a5 >2013-12-09 16:26:14,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52be697f >2013-12-09 16:26:15,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52be697f >2013-12-09 16:26:20,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4b66bf23 >2013-12-09 16:26:20,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4b66bf23 >2013-12-09 16:26:20,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 46ca2d67 >2013-12-09 16:26:20,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46ca2d67 >2013-12-09 16:26:25,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57012236 >2013-12-09 16:26:26,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 57012236 >2013-12-09 16:26:26,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5caac6d >2013-12-09 16:26:26,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5caac6d >2013-12-09 16:26:31,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35e37d8a >2013-12-09 16:26:32,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 35e37d8a >2013-12-09 16:26:32,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8297681 >2013-12-09 16:26:32,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8297681 >2013-12-09 16:26:34,771 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-73) No up server in cluster >2013-12-09 16:26:34,772 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-73) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:26:34,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23ff1a56 >2013-12-09 16:26:35,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterTasksListVDSCommand, return: [], log id: 23ff1a56 >2013-12-09 16:26:37,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4857ad6 >2013-12-09 16:26:37,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4857ad6 >2013-12-09 16:26:37,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3afd9de3 >2013-12-09 16:26:38,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3afd9de3 >2013-12-09 16:26:43,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4654534c >2013-12-09 16:26:43,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4654534c >2013-12-09 16:26:43,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b16c1b4 >2013-12-09 16:26:43,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b16c1b4 >2013-12-09 16:26:48,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49ad264b >2013-12-09 16:26:49,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 49ad264b >2013-12-09 16:26:49,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58cf5460 >2013-12-09 16:26:49,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58cf5460 >2013-12-09 16:26:54,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 50bbbdfa >2013-12-09 16:26:55,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 50bbbdfa >2013-12-09 16:26:55,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d48002e >2013-12-09 16:26:55,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d48002e >2013-12-09 16:27:00,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b56b952 >2013-12-09 16:27:00,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b56b952 >2013-12-09 16:27:00,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63052e86 >2013-12-09 16:27:01,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63052e86 >2013-12-09 16:27:06,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6314b88d >2013-12-09 16:27:06,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6314b88d >2013-12-09 16:27:06,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 420defdd >2013-12-09 16:27:07,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 420defdd >2013-12-09 16:27:12,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: cba571 >2013-12-09 16:27:12,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: cba571 >2013-12-09 16:27:12,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1554356c >2013-12-09 16:27:12,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1554356c >2013-12-09 16:27:17,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 43ca7be3 >2013-12-09 16:27:18,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 43ca7be3 >2013-12-09 16:27:18,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: d4c673d >2013-12-09 16:27:18,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d4c673d >2013-12-09 16:27:23,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65b906b9 >2013-12-09 16:27:24,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 65b906b9 >2013-12-09 16:27:24,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 295a4661 >2013-12-09 16:27:24,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 295a4661 >2013-12-09 16:27:29,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 47180f50 >2013-12-09 16:27:29,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 47180f50 >2013-12-09 16:27:29,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d5f9e36 >2013-12-09 16:27:30,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d5f9e36 >2013-12-09 16:27:35,048 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-99) No up server in cluster >2013-12-09 16:27:35,048 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-99) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:27:35,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2eb29d45 >2013-12-09 16:27:35,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3adf860b >2013-12-09 16:27:35,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2eb29d45 >2013-12-09 16:27:35,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3adf860b >2013-12-09 16:27:35,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a94fdf4 >2013-12-09 16:27:35,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a94fdf4 >2013-12-09 16:27:40,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 22bf11f9 >2013-12-09 16:27:41,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 22bf11f9 >2013-12-09 16:27:41,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52be7494 >2013-12-09 16:27:41,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52be7494 >2013-12-09 16:27:46,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 716de619 >2013-12-09 16:27:47,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 716de619 >2013-12-09 16:27:47,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 46b01e0f >2013-12-09 16:27:47,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46b01e0f >2013-12-09 16:27:52,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 764a89f4 >2013-12-09 16:27:52,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 764a89f4 >2013-12-09 16:27:52,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 601f6e7c >2013-12-09 16:27:53,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 601f6e7c >2013-12-09 16:27:58,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 50c2ff50 >2013-12-09 16:27:58,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 50c2ff50 >2013-12-09 16:27:58,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 508a2848 >2013-12-09 16:27:58,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 508a2848 >2013-12-09 16:28:03,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4db3f03a >2013-12-09 16:28:04,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4db3f03a >2013-12-09 16:28:04,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52a903f0 >2013-12-09 16:28:04,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52a903f0 >2013-12-09 16:28:09,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 468fb469 >2013-12-09 16:28:10,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 468fb469 >2013-12-09 16:28:10,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c42ebcd >2013-12-09 16:28:10,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c42ebcd >2013-12-09 16:28:15,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73222dfa >2013-12-09 16:28:16,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 73222dfa >2013-12-09 16:28:16,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 525c9851 >2013-12-09 16:28:16,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 525c9851 >2013-12-09 16:28:21,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 775adc3c >2013-12-09 16:28:21,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 775adc3c >2013-12-09 16:28:21,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 593d997c >2013-12-09 16:28:22,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 593d997c >2013-12-09 16:28:27,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: d6f9e59 >2013-12-09 16:28:27,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: d6f9e59 >2013-12-09 16:28:27,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1dac0ed9 >2013-12-09 16:28:27,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1dac0ed9 >2013-12-09 16:28:32,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 42afab89 >2013-12-09 16:28:33,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 42afab89 >2013-12-09 16:28:33,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e9d8100 >2013-12-09 16:28:33,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e9d8100 >2013-12-09 16:28:35,316 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-18) No up server in cluster >2013-12-09 16:28:35,316 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-18) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:28:35,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 515fa236 >2013-12-09 16:28:35,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterTasksListVDSCommand, return: [], log id: 515fa236 >2013-12-09 16:28:38,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 169c0e42 >2013-12-09 16:28:39,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 169c0e42 >2013-12-09 16:28:39,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 22935fd0 >2013-12-09 16:28:39,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22935fd0 >2013-12-09 16:28:44,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b3cd8b2 >2013-12-09 16:28:44,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b3cd8b2 >2013-12-09 16:28:44,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: c166ef3 >2013-12-09 16:28:45,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c166ef3 >2013-12-09 16:28:50,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 339ee197 >2013-12-09 16:28:50,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 339ee197 >2013-12-09 16:28:50,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 684c1172 >2013-12-09 16:28:50,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 684c1172 >2013-12-09 16:28:55,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1cefa46c >2013-12-09 16:28:56,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1cefa46c >2013-12-09 16:28:56,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d0141ee >2013-12-09 16:28:56,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d0141ee >2013-12-09 16:29:01,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6a9283d >2013-12-09 16:29:02,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6a9283d >2013-12-09 16:29:02,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53b9268d >2013-12-09 16:29:02,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53b9268d >2013-12-09 16:29:07,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 48a4e357 >2013-12-09 16:29:07,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 48a4e357 >2013-12-09 16:29:07,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 148fe311 >2013-12-09 16:29:08,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 148fe311 >2013-12-09 16:29:13,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3f9a71de >2013-12-09 16:29:13,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3f9a71de >2013-12-09 16:29:13,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6ae6cda7 >2013-12-09 16:29:14,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ae6cda7 >2013-12-09 16:29:19,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e5aa589 >2013-12-09 16:29:19,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: e5aa589 >2013-12-09 16:29:19,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f4e0190 >2013-12-09 16:29:19,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f4e0190 >2013-12-09 16:29:24,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d81b19d >2013-12-09 16:29:25,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d81b19d >2013-12-09 16:29:25,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e59dfc9 >2013-12-09 16:29:25,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e59dfc9 >2013-12-09 16:29:30,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68dbbd4e >2013-12-09 16:29:31,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 68dbbd4e >2013-12-09 16:29:31,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6307cf85 >2013-12-09 16:29:31,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6307cf85 >2013-12-09 16:29:35,597 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-47) No up server in cluster >2013-12-09 16:29:35,597 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-47) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:29:35,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63dd44ed >2013-12-09 16:29:35,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterTasksListVDSCommand, return: [], log id: 63dd44ed >2013-12-09 16:29:36,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 12a2ea3d >2013-12-09 16:29:36,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 12a2ea3d >2013-12-09 16:29:36,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2228bf7a >2013-12-09 16:29:37,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2228bf7a >2013-12-09 16:29:42,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 14507dd5 >2013-12-09 16:29:42,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 14507dd5 >2013-12-09 16:29:42,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7e7b3079 >2013-12-09 16:29:42,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e7b3079 >2013-12-09 16:29:47,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1990188c >2013-12-09 16:29:48,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1990188c >2013-12-09 16:29:48,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 564e4a69 >2013-12-09 16:29:48,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 564e4a69 >2013-12-09 16:29:53,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d827aa6 >2013-12-09 16:29:54,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d827aa6 >2013-12-09 16:29:54,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fff9b32 >2013-12-09 16:29:54,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fff9b32 >2013-12-09 16:29:59,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 17ae18ca >2013-12-09 16:29:59,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 17ae18ca >2013-12-09 16:29:59,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d113ef4 >2013-12-09 16:30:00,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d113ef4 >2013-12-09 16:30:05,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c900d92 >2013-12-09 16:30:05,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5c900d92 >2013-12-09 16:30:05,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10aa5c10 >2013-12-09 16:30:05,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10aa5c10 >2013-12-09 16:30:11,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6dfcfb8e >2013-12-09 16:30:11,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6dfcfb8e >2013-12-09 16:30:11,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a0507b8 >2013-12-09 16:30:11,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a0507b8 >2013-12-09 16:30:16,513 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-10) Running command: LoginAdminUserCommand internal: false. >2013-12-09 16:30:16,522 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-10) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2013-12-09 16:30:16,561 INFO [org.ovirt.engine.api.restapi.security.auth.LoginValidator] (ajp-/127.0.0.1:8702-15) Validating session failed, reason: Session does not exist. >2013-12-09 16:30:16,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 203eb495 >2013-12-09 16:30:17,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 203eb495 >2013-12-09 16:30:17,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e464220 >2013-12-09 16:30:17,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e464220 >2013-12-09 16:30:22,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 56a04b9b >2013-12-09 16:30:23,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 56a04b9b >2013-12-09 16:30:23,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 21d39e3f >2013-12-09 16:30:23,225 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-12) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-09 16:30:23,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21d39e3f >2013-12-09 16:30:28,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 726c9fd0 >2013-12-09 16:30:28,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 726c9fd0 >2013-12-09 16:30:28,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 195eed29 >2013-12-09 16:30:28,867 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-5) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-09 16:30:28,935 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-15) Theme /80-rhs-1.brand has no property defined for key resources >2013-12-09 16:30:29,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 195eed29 >2013-12-09 16:30:34,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 530c4f0e >2013-12-09 16:30:34,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 530c4f0e >2013-12-09 16:30:34,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2087db45 >2013-12-09 16:30:34,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2087db45 >2013-12-09 16:30:35,887 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-32) No up server in cluster >2013-12-09 16:30:35,887 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-32) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:30:35,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3bbf0d54 >2013-12-09 16:30:36,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3bbf0d54 >2013-12-09 16:30:39,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 45225644 >2013-12-09 16:30:40,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 45225644 >2013-12-09 16:30:40,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74db84f8 >2013-12-09 16:30:40,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74db84f8 >2013-12-09 16:30:45,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d58fcff >2013-12-09 16:30:46,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d58fcff >2013-12-09 16:30:46,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f826ae8 >2013-12-09 16:30:46,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f826ae8 >2013-12-09 16:30:51,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6000c01 >2013-12-09 16:30:51,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6000c01 >2013-12-09 16:30:51,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b735bb8 >2013-12-09 16:30:52,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b735bb8 >2013-12-09 16:30:57,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3542481e >2013-12-09 16:30:57,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3542481e >2013-12-09 16:30:57,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3a0ae6a0 >2013-12-09 16:30:57,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a0ae6a0 >2013-12-09 16:31:03,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2510b127 >2013-12-09 16:31:03,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2510b127 >2013-12-09 16:31:03,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 39f44a7d >2013-12-09 16:31:03,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39f44a7d >2013-12-09 16:31:08,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54e04645 >2013-12-09 16:31:09,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 54e04645 >2013-12-09 16:31:09,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 497de648 >2013-12-09 16:31:09,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 497de648 >2013-12-09 16:31:14,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6c67362 >2013-12-09 16:31:15,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6c67362 >2013-12-09 16:31:15,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 229b6a3d >2013-12-09 16:31:15,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 229b6a3d >2013-12-09 16:31:20,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17121845 >2013-12-09 16:31:20,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 17121845 >2013-12-09 16:31:20,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7b4e4734 >2013-12-09 16:31:21,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b4e4734 >2013-12-09 16:31:26,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 37755a0d >2013-12-09 16:31:26,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 37755a0d >2013-12-09 16:31:26,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32127c08 >2013-12-09 16:31:26,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32127c08 >2013-12-09 16:31:31,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a7c61dc >2013-12-09 16:31:32,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3a7c61dc >2013-12-09 16:31:32,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 348b737b >2013-12-09 16:31:32,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 348b737b >2013-12-09 16:31:36,165 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) No up server in cluster >2013-12-09 16:31:36,165 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:31:36,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1eabefb6 >2013-12-09 16:31:36,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterTasksListVDSCommand, return: [], log id: 1eabefb6 >2013-12-09 16:31:37,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2aa9c82f >2013-12-09 16:31:38,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2aa9c82f >2013-12-09 16:31:38,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2669115c >2013-12-09 16:31:38,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2669115c >2013-12-09 16:31:43,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32f39e05 >2013-12-09 16:31:43,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 32f39e05 >2013-12-09 16:31:43,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5f926242 >2013-12-09 16:31:44,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f926242 >2013-12-09 16:31:49,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1da42c9d >2013-12-09 16:31:49,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1da42c9d >2013-12-09 16:31:49,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1095f262 >2013-12-09 16:31:50,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1095f262 >2013-12-09 16:31:55,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ad9b559 >2013-12-09 16:31:55,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1ad9b559 >2013-12-09 16:31:55,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f6dbe35 >2013-12-09 16:31:55,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f6dbe35 >2013-12-09 16:32:00,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e3f9d06 >2013-12-09 16:32:01,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e3f9d06 >2013-12-09 16:32:01,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 707abbff >2013-12-09 16:32:01,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 707abbff >2013-12-09 16:32:06,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 27000bff >2013-12-09 16:32:07,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 27000bff >2013-12-09 16:32:07,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 59f46f3a >2013-12-09 16:32:07,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59f46f3a >2013-12-09 16:32:12,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4c8c297f >2013-12-09 16:32:12,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4c8c297f >2013-12-09 16:32:12,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ce5ee31 >2013-12-09 16:32:13,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ce5ee31 >2013-12-09 16:32:18,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c5bf08a >2013-12-09 16:32:18,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5c5bf08a >2013-12-09 16:32:18,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4c255409 >2013-12-09 16:32:18,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c255409 >2013-12-09 16:32:23,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 638029c4 >2013-12-09 16:32:24,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 638029c4 >2013-12-09 16:32:24,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 28c44656 >2013-12-09 16:32:24,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28c44656 >2013-12-09 16:32:29,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 256d71fe >2013-12-09 16:32:30,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 256d71fe >2013-12-09 16:32:30,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41ad654c >2013-12-09 16:32:30,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41ad654c >2013-12-09 16:32:35,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3560016a >2013-12-09 16:32:35,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3560016a >2013-12-09 16:32:35,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 656b1e5e >2013-12-09 16:32:36,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 656b1e5e >2013-12-09 16:32:36,443 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-31) No up server in cluster >2013-12-09 16:32:36,443 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-31) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:32:36,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 453a4952 >2013-12-09 16:32:36,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterTasksListVDSCommand, return: [], log id: 453a4952 >2013-12-09 16:32:41,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8862342 >2013-12-09 16:32:41,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 8862342 >2013-12-09 16:32:41,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41e533fc >2013-12-09 16:32:42,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41e533fc >2013-12-09 16:32:47,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 10fa0628 >2013-12-09 16:32:47,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 10fa0628 >2013-12-09 16:32:47,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1ccaacab >2013-12-09 16:32:47,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ccaacab >2013-12-09 16:32:52,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5be54012 >2013-12-09 16:32:53,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5be54012 >2013-12-09 16:32:53,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 73ae4be >2013-12-09 16:32:53,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73ae4be >2013-12-09 16:32:58,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6dd7d68c >2013-12-09 16:32:59,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6dd7d68c >2013-12-09 16:32:59,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55a121ce >2013-12-09 16:32:59,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55a121ce >2013-12-09 16:33:04,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5089fde9 >2013-12-09 16:33:04,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5089fde9 >2013-12-09 16:33:04,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 250480a6 >2013-12-09 16:33:05,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 250480a6 >2013-12-09 16:33:10,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 38db3542 >2013-12-09 16:33:10,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 38db3542 >2013-12-09 16:33:10,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 905e866 >2013-12-09 16:33:10,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 905e866 >2013-12-09 16:33:15,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15e75251 >2013-12-09 16:33:16,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 15e75251 >2013-12-09 16:33:16,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6beaba4d >2013-12-09 16:33:16,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6beaba4d >2013-12-09 16:33:21,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f489242 >2013-12-09 16:33:22,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2f489242 >2013-12-09 16:33:22,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 67971465 >2013-12-09 16:33:22,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67971465 >2013-12-09 16:33:27,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1e1bc4e9 >2013-12-09 16:33:27,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1e1bc4e9 >2013-12-09 16:33:27,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f366fb6 >2013-12-09 16:33:28,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f366fb6 >2013-12-09 16:33:33,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6dd87de6 >2013-12-09 16:33:33,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6dd87de6 >2013-12-09 16:33:33,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75a75252 >2013-12-09 16:33:33,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75a75252 >2013-12-09 16:33:36,728 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-40) No up server in cluster >2013-12-09 16:33:36,728 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-40) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:33:36,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20c7d35f >2013-12-09 16:33:37,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterTasksListVDSCommand, return: [], log id: 20c7d35f >2013-12-09 16:33:39,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e085f9d >2013-12-09 16:33:39,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e085f9d >2013-12-09 16:33:39,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7673fad0 >2013-12-09 16:33:39,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7673fad0 >2013-12-09 16:33:44,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c416966 >2013-12-09 16:33:45,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1c416966 >2013-12-09 16:33:45,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f13506d >2013-12-09 16:33:45,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f13506d >2013-12-09 16:33:50,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35e1946e >2013-12-09 16:33:51,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 35e1946e >2013-12-09 16:33:51,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26001fea >2013-12-09 16:33:51,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26001fea >2013-12-09 16:33:56,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ca07005 >2013-12-09 16:33:56,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1ca07005 >2013-12-09 16:33:56,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ef79c2b >2013-12-09 16:33:57,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ef79c2b >2013-12-09 16:34:02,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 57eca618 >2013-12-09 16:34:02,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 57eca618 >2013-12-09 16:34:02,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 659d9516 >2013-12-09 16:34:02,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 659d9516 >2013-12-09 16:34:07,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 34300148 >2013-12-09 16:34:08,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 34300148 >2013-12-09 16:34:08,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 600ff2a1 >2013-12-09 16:34:08,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 600ff2a1 >2013-12-09 16:34:13,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 90fcc03 >2013-12-09 16:34:14,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 90fcc03 >2013-12-09 16:34:14,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1854b51d >2013-12-09 16:34:14,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1854b51d >2013-12-09 16:34:19,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ac700a0 >2013-12-09 16:34:19,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4ac700a0 >2013-12-09 16:34:19,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b22c371 >2013-12-09 16:34:20,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b22c371 >2013-12-09 16:34:25,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3d5eecc2 >2013-12-09 16:34:25,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3d5eecc2 >2013-12-09 16:34:25,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e52226 >2013-12-09 16:34:26,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e52226 >2013-12-09 16:34:31,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3ff55b69 >2013-12-09 16:34:31,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3ff55b69 >2013-12-09 16:34:31,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c463214 >2013-12-09 16:34:31,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c463214 >2013-12-09 16:34:36,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5865064f >2013-12-09 16:34:37,011 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-79) No up server in cluster >2013-12-09 16:34:37,011 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-79) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:34:37,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3bd7f0a3 >2013-12-09 16:34:37,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5865064f >2013-12-09 16:34:37,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 60b1be19 >2013-12-09 16:34:37,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3bd7f0a3 >2013-12-09 16:34:37,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60b1be19 >2013-12-09 16:34:42,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59921cee >2013-12-09 16:34:43,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59921cee >2013-12-09 16:34:43,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64e8bab6 >2013-12-09 16:34:43,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64e8bab6 >2013-12-09 16:34:48,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53bfc868 >2013-12-09 16:34:48,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 53bfc868 >2013-12-09 16:34:48,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38b88422 >2013-12-09 16:34:49,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38b88422 >2013-12-09 16:34:54,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 730ed994 >2013-12-09 16:34:54,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 730ed994 >2013-12-09 16:34:54,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7138feb0 >2013-12-09 16:34:54,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7138feb0 >2013-12-09 16:34:59,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 738c2082 >2013-12-09 16:35:00,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 738c2082 >2013-12-09 16:35:00,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 72278b64 >2013-12-09 16:35:00,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72278b64 >2013-12-09 16:35:05,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4217b7f >2013-12-09 16:35:06,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4217b7f >2013-12-09 16:35:06,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6eccc2a1 >2013-12-09 16:35:06,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6eccc2a1 >2013-12-09 16:35:11,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e1060a8 >2013-12-09 16:35:11,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7e1060a8 >2013-12-09 16:35:11,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 171b02ab >2013-12-09 16:35:12,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 171b02ab >2013-12-09 16:35:17,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 49ce63d2 >2013-12-09 16:35:17,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 49ce63d2 >2013-12-09 16:35:17,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5481f028 >2013-12-09 16:35:18,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5481f028 >2013-12-09 16:35:23,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4e73c598 >2013-12-09 16:35:23,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4e73c598 >2013-12-09 16:35:23,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 665b2c72 >2013-12-09 16:35:23,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 665b2c72 >2013-12-09 16:35:28,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54bf8554 >2013-12-09 16:35:29,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 54bf8554 >2013-12-09 16:35:29,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 40b71074 >2013-12-09 16:35:29,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40b71074 >2013-12-09 16:35:34,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 62e04896 >2013-12-09 16:35:35,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 62e04896 >2013-12-09 16:35:35,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a32fe60 >2013-12-09 16:35:35,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a32fe60 >2013-12-09 16:35:37,289 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-24) No up server in cluster >2013-12-09 16:35:37,289 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-24) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:35:37,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 507b1ad9 >2013-12-09 16:35:37,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterTasksListVDSCommand, return: [], log id: 507b1ad9 >2013-12-09 16:35:40,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2cc0e903 >2013-12-09 16:35:40,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2cc0e903 >2013-12-09 16:35:40,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 74ceb05d >2013-12-09 16:35:41,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74ceb05d >2013-12-09 16:35:46,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 45b2ec9b >2013-12-09 16:35:46,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 45b2ec9b >2013-12-09 16:35:46,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4924cba6 >2013-12-09 16:35:46,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4924cba6 >2013-12-09 16:35:51,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 16e83f65 >2013-12-09 16:35:52,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 16e83f65 >2013-12-09 16:35:52,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 29f5eaa7 >2013-12-09 16:35:52,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29f5eaa7 >2013-12-09 16:35:57,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 18652d67 >2013-12-09 16:35:58,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 18652d67 >2013-12-09 16:35:58,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: f50b36c >2013-12-09 16:35:58,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f50b36c >2013-12-09 16:36:03,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: deeb8cd >2013-12-09 16:36:03,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: deeb8cd >2013-12-09 16:36:03,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 270a93cc >2013-12-09 16:36:04,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 270a93cc >2013-12-09 16:36:09,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 59d1ea0 >2013-12-09 16:36:09,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 59d1ea0 >2013-12-09 16:36:09,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19752a25 >2013-12-09 16:36:09,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19752a25 >2013-12-09 16:36:14,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3b0bc024 >2013-12-09 16:36:15,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3b0bc024 >2013-12-09 16:36:15,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 92f470e >2013-12-09 16:36:15,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 92f470e >2013-12-09 16:36:20,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 41f06174 >2013-12-09 16:36:21,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 41f06174 >2013-12-09 16:36:21,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2ec518b2 >2013-12-09 16:36:21,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ec518b2 >2013-12-09 16:36:26,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 304b2ff2 >2013-12-09 16:36:27,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 304b2ff2 >2013-12-09 16:36:27,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1588fc52 >2013-12-09 16:36:27,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1588fc52 >2013-12-09 16:36:32,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: ae4d8c1 >2013-12-09 16:36:32,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: ae4d8c1 >2013-12-09 16:36:32,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3d8e8ae5 >2013-12-09 16:36:33,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d8e8ae5 >2013-12-09 16:36:37,567 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) No up server in cluster >2013-12-09 16:36:37,567 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:36:37,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3c64579c >2013-12-09 16:36:37,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3c64579c >2013-12-09 16:36:38,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5558665b >2013-12-09 16:36:38,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5558665b >2013-12-09 16:36:38,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2f487ff5 >2013-12-09 16:36:38,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f487ff5 >2013-12-09 16:36:43,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 540ff55d >2013-12-09 16:36:44,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 540ff55d >2013-12-09 16:36:44,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2b9b5636 >2013-12-09 16:36:44,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b9b5636 >2013-12-09 16:36:49,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 543c151f >2013-12-09 16:36:50,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 543c151f >2013-12-09 16:36:50,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5fea1c6 >2013-12-09 16:36:50,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fea1c6 >2013-12-09 16:36:55,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6592621f >2013-12-09 16:36:55,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6592621f >2013-12-09 16:36:55,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a5c3d83 >2013-12-09 16:36:56,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a5c3d83 >2013-12-09 16:37:01,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 227db605 >2013-12-09 16:37:01,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 227db605 >2013-12-09 16:37:01,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6518e4f3 >2013-12-09 16:37:01,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6518e4f3 >2013-12-09 16:37:06,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d9bfc1c >2013-12-09 16:37:07,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6d9bfc1c >2013-12-09 16:37:07,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 543ebc58 >2013-12-09 16:37:07,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 543ebc58 >2013-12-09 16:37:12,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3570ce93 >2013-12-09 16:37:13,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3570ce93 >2013-12-09 16:37:13,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33798967 >2013-12-09 16:37:13,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33798967 >2013-12-09 16:37:18,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 168f277f >2013-12-09 16:37:19,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 168f277f >2013-12-09 16:37:19,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f347357 >2013-12-09 16:37:19,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f347357 >2013-12-09 16:37:24,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6e671ce7 >2013-12-09 16:37:24,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6e671ce7 >2013-12-09 16:37:24,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1da4a22d >2013-12-09 16:37:25,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1da4a22d >2013-12-09 16:37:30,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 78836373 >2013-12-09 16:37:30,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 78836373 >2013-12-09 16:37:30,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68634870 >2013-12-09 16:37:30,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68634870 >2013-12-09 16:37:35,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 26975b9d >2013-12-09 16:37:36,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 26975b9d >2013-12-09 16:37:36,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 489b2c9e >2013-12-09 16:37:36,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 489b2c9e >2013-12-09 16:37:37,856 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-90) No up server in cluster >2013-12-09 16:37:37,857 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-90) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:37:37,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 75a90f42 >2013-12-09 16:37:38,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterTasksListVDSCommand, return: [], log id: 75a90f42 >2013-12-09 16:37:41,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 434cfddf >2013-12-09 16:37:42,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 434cfddf >2013-12-09 16:37:42,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2c3d82ab >2013-12-09 16:37:42,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c3d82ab >2013-12-09 16:37:47,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 188c6f59 >2013-12-09 16:37:47,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 188c6f59 >2013-12-09 16:37:47,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f55750c >2013-12-09 16:37:48,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f55750c >2013-12-09 16:37:53,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2b7f44f5 >2013-12-09 16:37:53,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2b7f44f5 >2013-12-09 16:37:53,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4af7a053 >2013-12-09 16:37:53,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4af7a053 >2013-12-09 16:37:58,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7efdfdf7 >2013-12-09 16:37:59,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7efdfdf7 >2013-12-09 16:37:59,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 244c1b19 >2013-12-09 16:37:59,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 244c1b19 >2013-12-09 16:38:04,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 68c079a9 >2013-12-09 16:38:05,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 68c079a9 >2013-12-09 16:38:05,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 64f86711 >2013-12-09 16:38:05,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [6d1f044] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64f86711 >2013-12-09 16:38:10,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32f952b7 >2013-12-09 16:38:11,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 32f952b7 >2013-12-09 16:38:11,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7829d919 >2013-12-09 16:38:11,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7829d919 >2013-12-09 16:38:16,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 28ff1680 >2013-12-09 16:38:16,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 28ff1680 >2013-12-09 16:38:16,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1815d592 >2013-12-09 16:38:17,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1815d592 >2013-12-09 16:38:22,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6be2edc7 >2013-12-09 16:38:22,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6be2edc7 >2013-12-09 16:38:22,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6eedad84 >2013-12-09 16:38:22,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6eedad84 >2013-12-09 16:38:27,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 135bd480 >2013-12-09 16:38:28,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 135bd480 >2013-12-09 16:38:28,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6ee04c7a >2013-12-09 16:38:28,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ee04c7a >2013-12-09 16:38:33,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7536d7bd >2013-12-09 16:38:34,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7536d7bd >2013-12-09 16:38:34,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a8106a0 >2013-12-09 16:38:34,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a8106a0 >2013-12-09 16:38:38,138 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-99) No up server in cluster >2013-12-09 16:38:38,138 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-99) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:38:38,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7170749b >2013-12-09 16:38:38,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7170749b >2013-12-09 16:38:39,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 725ba945 >2013-12-09 16:38:39,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 725ba945 >2013-12-09 16:38:39,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6b1f7b14 >2013-12-09 16:38:40,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b1f7b14 >2013-12-09 16:38:45,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6be72b27 >2013-12-09 16:38:45,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6be72b27 >2013-12-09 16:38:45,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 70b23432 >2013-12-09 16:38:45,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70b23432 >2013-12-09 16:38:50,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55140f83 >2013-12-09 16:38:51,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 55140f83 >2013-12-09 16:38:51,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 9f7bcd5 >2013-12-09 16:38:51,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9f7bcd5 >2013-12-09 16:38:56,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4f2b4f61 >2013-12-09 16:38:57,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4f2b4f61 >2013-12-09 16:38:57,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 38681a20 >2013-12-09 16:38:57,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38681a20 >2013-12-09 16:39:02,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 582882a5 >2013-12-09 16:39:03,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 582882a5 >2013-12-09 16:39:03,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55332bb >2013-12-09 16:39:03,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55332bb >2013-12-09 16:39:08,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7e2d3f37 >2013-12-09 16:39:08,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7e2d3f37 >2013-12-09 16:39:08,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2ec49e87 >2013-12-09 16:39:09,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ec49e87 >2013-12-09 16:39:14,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 68d4aa96 >2013-12-09 16:39:14,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 68d4aa96 >2013-12-09 16:39:14,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4389241f >2013-12-09 16:39:14,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4389241f >2013-12-09 16:39:19,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23f8ff99 >2013-12-09 16:39:20,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 23f8ff99 >2013-12-09 16:39:20,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 55320dd1 >2013-12-09 16:39:20,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55320dd1 >2013-12-09 16:39:25,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7a194869 >2013-12-09 16:39:26,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7a194869 >2013-12-09 16:39:26,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d76afee >2013-12-09 16:39:26,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d76afee >2013-12-09 16:39:31,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 551e0b2b >2013-12-09 16:39:31,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 551e0b2b >2013-12-09 16:39:31,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65107ac >2013-12-09 16:39:32,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65107ac >2013-12-09 16:39:37,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4746379a >2013-12-09 16:39:37,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4746379a >2013-12-09 16:39:37,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 43bd60 >2013-12-09 16:39:37,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43bd60 >2013-12-09 16:39:38,419 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) No up server in cluster >2013-12-09 16:39:38,419 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:39:38,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 226517fe >2013-12-09 16:39:38,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterTasksListVDSCommand, return: [], log id: 226517fe >2013-12-09 16:39:42,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1148b489 >2013-12-09 16:39:43,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1148b489 >2013-12-09 16:39:43,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6133cc23 >2013-12-09 16:39:43,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6133cc23 >2013-12-09 16:39:48,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6bae18a0 >2013-12-09 16:39:49,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6bae18a0 >2013-12-09 16:39:49,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: e5db5ce >2013-12-09 16:39:49,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e5db5ce >2013-12-09 16:39:54,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2348860a >2013-12-09 16:39:55,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2348860a >2013-12-09 16:39:55,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: b6d518b >2013-12-09 16:39:55,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b6d518b >2013-12-09 16:40:00,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 58595eb2 >2013-12-09 16:40:00,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 58595eb2 >2013-12-09 16:40:00,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 32f88f0d >2013-12-09 16:40:01,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32f88f0d >2013-12-09 16:40:06,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19336f3a >2013-12-09 16:40:06,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19336f3a >2013-12-09 16:40:06,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 30eb7899 >2013-12-09 16:40:06,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30eb7899 >2013-12-09 16:40:11,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 54043620 >2013-12-09 16:40:12,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 54043620 >2013-12-09 16:40:12,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31245a2a >2013-12-09 16:40:12,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31245a2a >2013-12-09 16:40:17,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2fe9f8e3 >2013-12-09 16:40:18,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2fe9f8e3 >2013-12-09 16:40:18,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a4804 >2013-12-09 16:40:18,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a4804 >2013-12-09 16:40:23,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3f3e0c7f >2013-12-09 16:40:23,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3f3e0c7f >2013-12-09 16:40:23,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7af489d1 >2013-12-09 16:40:24,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7af489d1 >2013-12-09 16:40:29,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 754d7e0 >2013-12-09 16:40:29,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 754d7e0 >2013-12-09 16:40:29,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 176f6c48 >2013-12-09 16:40:30,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 176f6c48 >2013-12-09 16:40:35,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 204a1c4 >2013-12-09 16:40:35,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 204a1c4 >2013-12-09 16:40:35,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d5e9c58 >2013-12-09 16:40:35,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d5e9c58 >2013-12-09 16:40:38,708 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-43) No up server in cluster >2013-12-09 16:40:38,708 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-43) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:40:38,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3098ada2 >2013-12-09 16:40:38,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3098ada2 >2013-12-09 16:40:40,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 26c9aabc >2013-12-09 16:40:41,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 26c9aabc >2013-12-09 16:40:41,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a047af7 >2013-12-09 16:40:41,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a047af7 >2013-12-09 16:40:46,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 527b6cd8 >2013-12-09 16:40:47,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 527b6cd8 >2013-12-09 16:40:47,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 66f661e9 >2013-12-09 16:40:47,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66f661e9 >2013-12-09 16:40:52,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 65bb75ff >2013-12-09 16:40:52,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 65bb75ff >2013-12-09 16:40:52,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2d130b03 >2013-12-09 16:40:53,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d130b03 >2013-12-09 16:40:58,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4880b0cd >2013-12-09 16:40:58,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4880b0cd >2013-12-09 16:40:58,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6de7d305 >2013-12-09 16:40:58,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6de7d305 >2013-12-09 16:41:03,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7724dc5a >2013-12-09 16:41:04,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7724dc5a >2013-12-09 16:41:04,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 588c9f29 >2013-12-09 16:41:04,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 588c9f29 >2013-12-09 16:41:09,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 621938ee >2013-12-09 16:41:10,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 621938ee >2013-12-09 16:41:10,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5ca2fe20 >2013-12-09 16:41:10,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ca2fe20 >2013-12-09 16:41:15,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3238743 >2013-12-09 16:41:15,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3238743 >2013-12-09 16:41:15,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4ea7c887 >2013-12-09 16:41:16,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ea7c887 >2013-12-09 16:41:21,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7eef18e7 >2013-12-09 16:41:21,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7eef18e7 >2013-12-09 16:41:21,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 35ef093e >2013-12-09 16:41:21,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35ef093e >2013-12-09 16:41:27,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4cd36dd1 >2013-12-09 16:41:27,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4cd36dd1 >2013-12-09 16:41:27,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7fbfcb76 >2013-12-09 16:41:27,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fbfcb76 >2013-12-09 16:41:32,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7f29c6fa >2013-12-09 16:41:33,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 7f29c6fa >2013-12-09 16:41:33,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 60e9dec7 >2013-12-09 16:41:33,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60e9dec7 >2013-12-09 16:41:38,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76d5186c >2013-12-09 16:41:38,981 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-12) No up server in cluster >2013-12-09 16:41:38,981 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-12) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:41:38,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 723bd355 >2013-12-09 16:41:39,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 76d5186c >2013-12-09 16:41:39,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1b85e388 >2013-12-09 16:41:39,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b85e388 >2013-12-09 16:41:39,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) FINISH, GlusterTasksListVDSCommand, return: [], log id: 723bd355 >2013-12-09 16:41:44,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 233d8926 >2013-12-09 16:41:44,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 233d8926 >2013-12-09 16:41:44,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 36ef35f6 >2013-12-09 16:41:45,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36ef35f6 >2013-12-09 16:41:50,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 220dafa0 >2013-12-09 16:41:50,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 220dafa0 >2013-12-09 16:41:50,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 66d25b83 >2013-12-09 16:41:50,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66d25b83 >2013-12-09 16:41:55,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1a6fba7e >2013-12-09 16:41:56,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1a6fba7e >2013-12-09 16:41:56,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7d76d723 >2013-12-09 16:41:56,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d76d723 >2013-12-09 16:42:01,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 55ea0cf1 >2013-12-09 16:42:02,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 55ea0cf1 >2013-12-09 16:42:02,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 214b5749 >2013-12-09 16:42:02,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 214b5749 >2013-12-09 16:42:07,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 12a0f016 >2013-12-09 16:42:07,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 12a0f016 >2013-12-09 16:42:07,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 37aa0ca6 >2013-12-09 16:42:08,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37aa0ca6 >2013-12-09 16:42:13,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e7496ce >2013-12-09 16:42:13,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3e7496ce >2013-12-09 16:42:13,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5661a90 >2013-12-09 16:42:13,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5661a90 >2013-12-09 16:42:18,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1d92496c >2013-12-09 16:42:19,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 1d92496c >2013-12-09 16:42:19,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6f9aa2b >2013-12-09 16:42:19,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f9aa2b >2013-12-09 16:42:24,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 180c50bf >2013-12-09 16:42:25,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 180c50bf >2013-12-09 16:42:25,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6cd891b >2013-12-09 16:42:25,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6cd891b >2013-12-09 16:42:30,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 23ce29e1 >2013-12-09 16:42:30,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 23ce29e1 >2013-12-09 16:42:30,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 252d5c71 >2013-12-09 16:42:31,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 252d5c71 >2013-12-09 16:42:36,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1ff6335b >2013-12-09 16:42:36,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1ff6335b >2013-12-09 16:42:36,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7795ac6 >2013-12-09 16:42:37,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7795ac6 >2013-12-09 16:42:39,238 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-36) No up server in cluster >2013-12-09 16:42:39,238 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-36) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:42:39,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 32841625 >2013-12-09 16:42:39,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterTasksListVDSCommand, return: [], log id: 32841625 >2013-12-09 16:42:42,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7606810a >2013-12-09 16:42:42,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7606810a >2013-12-09 16:42:42,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58b24046 >2013-12-09 16:42:42,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58b24046 >2013-12-09 16:42:47,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 63ad23cd >2013-12-09 16:42:48,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 63ad23cd >2013-12-09 16:42:48,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6084b17b >2013-12-09 16:42:48,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6084b17b >2013-12-09 16:42:53,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 321af212 >2013-12-09 16:42:54,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 321af212 >2013-12-09 16:42:54,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 57d3cab1 >2013-12-09 16:42:54,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57d3cab1 >2013-12-09 16:42:59,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 74ea4df0 >2013-12-09 16:42:59,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 74ea4df0 >2013-12-09 16:42:59,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 71a647c9 >2013-12-09 16:43:00,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71a647c9 >2013-12-09 16:43:05,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 53d433e >2013-12-09 16:43:05,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 53d433e >2013-12-09 16:43:05,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 7317dcd4 >2013-12-09 16:43:05,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7317dcd4 >2013-12-09 16:43:10,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 413e33d1 >2013-12-09 16:43:11,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 413e33d1 >2013-12-09 16:43:11,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2e6447ed >2013-12-09 16:43:11,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e6447ed >2013-12-09 16:43:16,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3db6731 >2013-12-09 16:43:17,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3db6731 >2013-12-09 16:43:17,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7c99b8e9 >2013-12-09 16:43:17,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c99b8e9 >2013-12-09 16:43:22,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6b75ac0c >2013-12-09 16:43:22,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6b75ac0c >2013-12-09 16:43:22,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 593607f0 >2013-12-09 16:43:23,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 593607f0 >2013-12-09 16:43:28,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1c99245 >2013-12-09 16:43:28,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1c99245 >2013-12-09 16:43:28,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5b4aa5b0 >2013-12-09 16:43:28,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b4aa5b0 >2013-12-09 16:43:33,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 640e919e >2013-12-09 16:43:34,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 640e919e >2013-12-09 16:43:34,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 403e7b25 >2013-12-09 16:43:34,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 403e7b25 >2013-12-09 16:43:39,526 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-70) No up server in cluster >2013-12-09 16:43:39,526 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-70) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:43:39,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d02d904 >2013-12-09 16:43:39,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5427b3d7 >2013-12-09 16:43:39,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4d02d904 >2013-12-09 16:43:40,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5427b3d7 >2013-12-09 16:43:40,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5364c5b1 >2013-12-09 16:43:40,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5364c5b1 >2013-12-09 16:43:45,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5267f9a3 >2013-12-09 16:43:46,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 5267f9a3 >2013-12-09 16:43:46,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 23f91717 >2013-12-09 16:43:46,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23f91717 >2013-12-09 16:43:51,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 770abbf8 >2013-12-09 16:43:52,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 770abbf8 >2013-12-09 16:43:52,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c0ad49e >2013-12-09 16:43:52,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c0ad49e >2013-12-09 16:43:57,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 54ed7216 >2013-12-09 16:43:58,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 54ed7216 >2013-12-09 16:43:58,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 34a7d215 >2013-12-09 16:43:58,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34a7d215 >2013-12-09 16:44:03,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f6a6aea >2013-12-09 16:44:03,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f6a6aea >2013-12-09 16:44:03,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 58b983df >2013-12-09 16:44:04,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58b983df >2013-12-09 16:44:09,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4d71adec >2013-12-09 16:44:09,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4d71adec >2013-12-09 16:44:09,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 359d0d74 >2013-12-09 16:44:09,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 359d0d74 >2013-12-09 16:44:14,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 9355394 >2013-12-09 16:44:15,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 9355394 >2013-12-09 16:44:15,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e2bfc72 >2013-12-09 16:44:15,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e2bfc72 >2013-12-09 16:44:20,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: b0e11d4 >2013-12-09 16:44:21,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: b0e11d4 >2013-12-09 16:44:21,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: da7ebbd >2013-12-09 16:44:21,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: da7ebbd >2013-12-09 16:44:26,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2192e5ca >2013-12-09 16:44:27,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 2192e5ca >2013-12-09 16:44:27,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1f8fdcbb >2013-12-09 16:44:27,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f8fdcbb >2013-12-09 16:44:32,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5c8c4bdb >2013-12-09 16:44:32,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5c8c4bdb >2013-12-09 16:44:32,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 432f4242 >2013-12-09 16:44:33,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 432f4242 >2013-12-09 16:44:38,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 15df5802 >2013-12-09 16:44:38,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 15df5802 >2013-12-09 16:44:38,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5316fdd5 >2013-12-09 16:44:38,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5316fdd5 >2013-12-09 16:44:39,810 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-8) No up server in cluster >2013-12-09 16:44:39,810 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-8) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:44:39,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 5b319d2a >2013-12-09 16:44:40,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5b319d2a >2013-12-09 16:44:43,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6f30e517 >2013-12-09 16:44:44,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6f30e517 >2013-12-09 16:44:44,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 10f33349 >2013-12-09 16:44:44,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10f33349 >2013-12-09 16:44:49,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 674ff176 >2013-12-09 16:44:50,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 674ff176 >2013-12-09 16:44:50,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1e453de4 >2013-12-09 16:44:50,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e453de4 >2013-12-09 16:44:55,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5a7a1aa8 >2013-12-09 16:44:55,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 5a7a1aa8 >2013-12-09 16:44:55,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 120cf48 >2013-12-09 16:44:56,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 120cf48 >2013-12-09 16:45:01,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d710668 >2013-12-09 16:45:01,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2d710668 >2013-12-09 16:45:01,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: c31db94 >2013-12-09 16:45:01,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c31db94 >2013-12-09 16:45:06,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 4dedf310 >2013-12-09 16:45:07,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 4dedf310 >2013-12-09 16:45:07,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 17756f47 >2013-12-09 16:45:07,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17756f47 >2013-12-09 16:45:12,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ae1c497 >2013-12-09 16:45:13,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 4ae1c497 >2013-12-09 16:45:13,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 166341e6 >2013-12-09 16:45:13,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 166341e6 >2013-12-09 16:45:18,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52ff9c8b >2013-12-09 16:45:19,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 52ff9c8b >2013-12-09 16:45:19,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7d7126e2 >2013-12-09 16:45:19,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d7126e2 >2013-12-09 16:45:24,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 540c0007 >2013-12-09 16:45:24,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 540c0007 >2013-12-09 16:45:24,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: ba6f855 >2013-12-09 16:45:25,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ba6f855 >2013-12-09 16:45:30,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: a7d816f >2013-12-09 16:45:30,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: a7d816f >2013-12-09 16:45:30,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2bafc9e0 >2013-12-09 16:45:30,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bafc9e0 >2013-12-09 16:45:35,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e64d5da >2013-12-09 16:45:36,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: e64d5da >2013-12-09 16:45:36,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 4ac7eb10 >2013-12-09 16:45:36,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) [63f3d095] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ac7eb10 >2013-12-09 16:45:40,098 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-18) No up server in cluster >2013-12-09 16:45:40,098 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-18) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:45:40,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2c0f6929 >2013-12-09 16:45:40,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2c0f6929 >2013-12-09 16:45:41,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e56252f >2013-12-09 16:45:42,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 3e56252f >2013-12-09 16:45:42,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ddde22c >2013-12-09 16:45:42,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ddde22c >2013-12-09 16:45:47,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 52f17077 >2013-12-09 16:45:47,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 52f17077 >2013-12-09 16:45:47,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 173d8cb1 >2013-12-09 16:45:48,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 173d8cb1 >2013-12-09 16:45:53,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 786bbff9 >2013-12-09 16:45:53,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 786bbff9 >2013-12-09 16:45:53,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 8eccc9c >2013-12-09 16:45:53,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8eccc9c >2013-12-09 16:45:59,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 69b37e10 >2013-12-09 16:45:59,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 69b37e10 >2013-12-09 16:45:59,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5e561f00 >2013-12-09 16:45:59,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e561f00 >2013-12-09 16:46:04,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 741a8db >2013-12-09 16:46:05,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 741a8db >2013-12-09 16:46:05,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 35778d39 >2013-12-09 16:46:05,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35778d39 >2013-12-09 16:46:10,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3b019cf5 >2013-12-09 16:46:11,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3b019cf5 >2013-12-09 16:46:11,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6d0b25a9 >2013-12-09 16:46:11,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d0b25a9 >2013-12-09 16:46:16,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6578e0a6 >2013-12-09 16:46:16,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 6578e0a6 >2013-12-09 16:46:16,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 61bab08a >2013-12-09 16:46:17,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61bab08a >2013-12-09 16:46:22,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6a1b621b >2013-12-09 16:46:22,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 6a1b621b >2013-12-09 16:46:22,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3e5e949d >2013-12-09 16:46:22,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e5e949d >2013-12-09 16:46:27,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e275204 >2013-12-09 16:46:28,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3e275204 >2013-12-09 16:46:28,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 1bb32a0b >2013-12-09 16:46:28,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1bb32a0b >2013-12-09 16:46:33,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b160c64 >2013-12-09 16:46:34,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 7b160c64 >2013-12-09 16:46:34,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3cef81fc >2013-12-09 16:46:34,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3cef81fc >2013-12-09 16:46:39,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3e106bbd >2013-12-09 16:46:39,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 3e106bbd >2013-12-09 16:46:39,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 31c9ef81 >2013-12-09 16:46:40,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31c9ef81 >2013-12-09 16:46:40,376 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-35) No up server in cluster >2013-12-09 16:46:40,376 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-35) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:46:40,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 5922aa0e >2013-12-09 16:46:40,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5922aa0e >2013-12-09 16:46:45,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 36047795 >2013-12-09 16:46:45,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 36047795 >2013-12-09 16:46:45,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 6227aa87 >2013-12-09 16:46:46,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6227aa87 >2013-12-09 16:46:51,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 327d076f >2013-12-09 16:46:51,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 327d076f >2013-12-09 16:46:51,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 2f05e730 >2013-12-09 16:46:51,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f05e730 >2013-12-09 16:46:56,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 64e483b1 >2013-12-09 16:46:57,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 64e483b1 >2013-12-09 16:46:57,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7b81dcf3 >2013-12-09 16:46:57,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b81dcf3 >2013-12-09 16:47:02,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 76ea49eb >2013-12-09 16:47:03,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 76ea49eb >2013-12-09 16:47:03,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 47112137 >2013-12-09 16:47:03,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47112137 >2013-12-09 16:47:08,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1d356706 >2013-12-09 16:47:08,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1d356706 >2013-12-09 16:47:08,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6d3a77a7 >2013-12-09 16:47:09,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d3a77a7 >2013-12-09 16:47:14,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 75f8e886 >2013-12-09 16:47:14,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 75f8e886 >2013-12-09 16:47:14,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 3a15a1cb >2013-12-09 16:47:14,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a15a1cb >2013-12-09 16:47:19,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 25ab96c0 >2013-12-09 16:47:20,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 25ab96c0 >2013-12-09 16:47:20,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2d8eddaa >2013-12-09 16:47:20,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d8eddaa >2013-12-09 16:47:25,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 19ab818e >2013-12-09 16:47:26,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 19ab818e >2013-12-09 16:47:26,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 7ca481b6 >2013-12-09 16:47:26,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ca481b6 >2013-12-09 16:47:31,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterServersListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 52afe015 >2013-12-09 16:47:31,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterServersListVDSCommand, return: [10.70.37.118:CONNECTED, 10.70.37.74:CONNECTED], log id: 52afe015 >2013-12-09 16:47:31,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) START, GlusterVolumesListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 3c2430c3 >2013-12-09 16:47:32,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c2430c3 >2013-12-09 16:47:37,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 2808b639 >2013-12-09 16:47:37,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 2808b639 >2013-12-09 16:47:37,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: e671910 >2013-12-09 16:47:38,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e671910 >2013-12-09 16:47:40,673 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-84) No up server in cluster >2013-12-09 16:47:40,673 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-84) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:79) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2013-12-09 16:47:40,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) START, GlusterTasksListVDSCommand(HostName = host2, HostId = c9c09269-0f46-4fc7-8363-ce669677c150), log id: 435d1715 >2013-12-09 16:47:40,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) FINISH, GlusterTasksListVDSCommand, return: [], log id: 435d1715 >2013-12-09 16:47:43,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1cdcaad0 >2013-12-09 16:47:43,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 1cdcaad0 >2013-12-09 16:47:43,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 33ef206c >2013-12-09 16:47:43,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33ef206c >2013-12-09 16:47:48,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 20fbbcf5 >2013-12-09 16:47:49,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: 20fbbcf5 >2013-12-09 16:47:49,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 6973f702 >2013-12-09 16:47:49,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6973f702 >2013-12-09 16:47:54,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterServersListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: adef367 >2013-12-09 16:47:55,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterServersListVDSCommand, return: [10.70.37.74:CONNECTED, 10.70.37.118:CONNECTED], log id: adef367 >2013-12-09 16:47:55,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) START, GlusterVolumesListVDSCommand(HostName = host1, HostId = 5d7cd256-4218-47d7-9343-504074504d76), log id: 1a02064a >2013-12-09 16:47:55,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a02064a
<b>You cannot view the attachment while viewing its details because your browser does not support IFRAMEs. <a href="attachment.cgi?id=834307">View the attachment on a separate page</a>.</b>
View Attachment As Raw
Actions:
View
Attachments on
bug 1039537
: 834307